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ABSTRACT 

This volume consists of abridged reports of the 10 
panels that participated in a five-day conference in Washington 
during the summer of 197U. The primary objective of the conferenc was 
to provide an agenda for further research and development to guide 
the National Institute of Education in its planning and funding over 
the next several years. Both by the involvement of some 100 
practitioners, administrators, and researchers as panelists, and by 
the public debate and criticism of the panel reports, the institute 
aims to create a major role for the practitioner and research . , 
communities in determining the direction of government funding. The 
conference panels were organized around the following major points in 
the tareer of a teacher: (1) the teacher's recruitment, selection, 
and reten.tion (Panel 1); .(2) training and performance, as approached 
from various perspectives (Panels 2-6) ; and (3) instructional 
personnel utiliza^tion (Panel 7). In addition, several special problem 
areas for plannitfg and research were covered by another three panels. 
Thfese were the role of the -teacher in new instructional systems 
(Panel 8) , research methodology (Panel 9) , and theory development 
(Panel 10); Within its specific problem area, each panel refined its 
goal statement, outlined several approaches or overall strategies, ^ 
identified potential programs within each approach, and outlined 
illustrative projects so far as this was appropriate and feasible. 
(Author/BD) 
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PREFACE 

This volume consists of abridged reports of the ten panels that 
participated in a five-day conference in Washington during the summer 
of 1974, Jhe primary objective of this Conference was to provide^an 
agenda for further research and development to guide the Institute in 
* its planning and funding over the next several years. Both by the 
involvement of some )00 respected practitioners, administrators, and 
researchers as panelists, and by the public debate and criticism of the 
panel reports, the Institute aims to create a major role for the ^ 
practitioner and research coilmunities in determining the direction of 
government ^funding. 

The Conference itself is seen as only an event in the middle of 
the process. In many months of preparation for the Conference, the 
staff met with a number of groups—students, teachers, administrators, 
etc. —to develop coherent problem statements which served as a charge 
to the panelists. Panel chairman and others met both before and afteir 
the Conference; Several cfther panelists were commissioned to pull ^ 
together the major themes and recommendations that kept recurring in 
different panels (being reported in a separate Conference Summary Report), 
Reports are being distributed to practitioner and research communities. 
The Institute encourages other interest groups to debate and critique 
relevant panel reports from their own perspectives. 

jf 

The Conference rationale stems from the fraak acknowledgment that 
muih of the funding for educational research and dev^elopment projects 
has not been coordinated , and sequenced in such a way as to avoid undue 
duplication yet fill significant gaps, or in such a way as to build a 
cumulative Impact relevant to educational practice. Nor have an agency's 
affected constituericies ordinarily had the opportunity for public 
discussion of funding alternatives and proposed directions prAor to the 
actual allocation of funds. The Conference is thus s6en as tne first 
major Federal effort to develop a coordinated research effort in the 
social sciences, the only pomparable efforts being the National Cancer 
Plan and tjhe National Heart and Lung Institute Plan, which served as 
models for the present Conference, 

As one of the Conference panels points out, education in the United 
States is moving^ toward change, whether we do anything about it or not. 
The outcomes of sound research and development— though only a minute 
portion 6f the education dollars-provide the leverage by which such change 
can be affort^ed coherent direction, ^ 
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In implementing these notions for the area of teaching. Conference 
panels were organized around the major points in the career of a teacher: 

• t-he teacher's. recruitment, selection, and retention (Panel 1); 
f training and performance, as approached from various 

perspectives (Panels 2 through 6); and 

• utilization (Panel 7). 

In addition, several special problem areas for planning and research 
were covered by three further panels: 

• the role of the teacher in new instructional systems (Panel 8); 
f research methodology (Panel 9); and 

f theory development (Panel 10) • 
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Within its specific problem area, each panel refined its goal 
statement, outlined several " approaches " or overall strategies, 
identified potential ^' programs *' within each approach, and sketched 
illustrative projects so tar as this was appropriate and feasible. 
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Since the brunt of this work wa^ done in concentrated sessions in 
the space of a few days, the resulting documents are not polished, 
internally consistent, or exhaustive. They are working papers, and 
their publication is intended to stimulate debate and suggestions for 
refinement by serious readers. The abridged versions included toget^her 
here exhibit a similar lack of polish and reflect a similar intent. 
Queries and comments, or requests for individual panel reports, should 
be directed to: ' * , 



Garry L. McDaniels, Assistant Director 
Program on Teaching and Curriculum 
National Institute of Education 
Washington, D.C. 20208 
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GOAL JSTAimENT 

Panel one's Goal was:( 

To recomnj^nd research^ that will identify the factors affecting 
recruitment, selectioh, and retention of teachers and the means 
of improving these processes; and 

_ K — 

To plan exemplary research and development activities for devising, 
validating, and installing methods for improving individuals' and 
instltutions'decisions at critical points in a teacher's cajreer. 



PARTICIPANTS 

Dr. James Deneen, Chairperson 

Dr. Dale Bblton 

Mr^ William Demnert 

Dr. Goldine Gleser 

Ms. Sonja Nixon 

Dr. Robert Peck 

Dr. Nathan Quinones 

Ms. Susan Sherwin, Secretary 



-0 




ADVISORY MEMBERS 

Robert Bhaerman^ 
Roy Edelfelt 
David Imig 
James Scharf 
Mr. Richard Sharp 

9 



1 



SUMMARY j ^ 

The Fanel on Recruitment, Selection and Retention of Teachers organized 
the research Approaches under the functional nature of six events in a 
teacher's career. These Approaches reflect a concern with the nature 
of the processes that determine who does, or who does not become or 
remain a teacher. These approaches are concerned with: 

1. Recruitment (into teacher training 
and teaching itself). 

2. Selection (into both training and teaching). 

3. * Preparation (for teaching). 

4. Placement and orientation in a teaching 
posit ion . 

5. Supervision and in-service education. 

6. Position changes. 

DJSCUSSIOjN 

For some thirty years j^rior to 1970, school districts recruited and select- 
ed teachdyrs in a seller's market. Recruitment and selection measures 
focused on two areas: the candidate's availability and his or her po'ssession 
of appcopriate cer t if icat ion* ^ Even the latter criterion frequently had to 
be waived if classrooms .were to be staffed. 

Today, the mkrket for teachers is radically different. At least a quarter 
of a million certified teachers are seeking f all-:: f.mx? employment . Because 
graduating classes of teacher education institutions still total around 
200,000' .yeai?ly^ the supply of teachers continues to expand dramatically. 

Given this surplus, teacher educators and employers can now be more 
selective in admitting teacher trainees and teachers into training oppor- 
tunities and employment. Thus, research recruitment, selection, and 
retention must address two fundamental questions: How can we identify 
the best teach^fi..and the best potential teachers? How can we retain the 
y best teachers and'^^'teacher trainees? 

' 'i o 

The research problem raised in the first' question is essentially that of 
determining the critefria against which recruitment, selection, and 
retention decisions c^n be made in a valid manner. These issues call for 
attention to the problems of defining variables and improving the 
Vc^lidity of predictors. They also require research aimed at improving 

\ 
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the decision-makinfi processes and methods related to the functions 

of recruitment, selection, and retention. For example, how can a recruiajrfent 

program be structured to yield an optimally useful faculty for a school or 

school system? 

The classic research and development pattern in teacher recruitmgrrt:, selection, 
and retention consists in identifying criteria, selecting poten'tial predictors 
of those criteria, and empirically determining their predictive validity. The 
Panel, accordingly, gave early attention to criteria, predictor?, and vays of * 
basing judgments on their relationships. 
■f 

The Panel recognized that "the functions of recruitment, selection, and 
retention occurred at various stages in a teacher's career. For example, 
recruitment can be considered a's a process occurring at the college level 
(attracting undergradua.tes into teacher training) or at the district 
level (attracting teachers to employment). The Panel, therefore, discussed 
the processes of recruitment, selection, and retention on a functional level 
rather than specifically relating them to any one st^ge of the teaching 
career. 

In order to incorporat^aspects which could not he adequately represented 
by the Panel membership, the Pane.l' enlisted two advisory groups. The first 
advisory group included representatives from the American Federation of 
Teachers, the National Educatiion Association and the American Association 
of Colleges for Teacher Education. This group presented ideas on the 
involvement teachers in planning, conducting and evaluating research 
and in-servic^ teacher education. The advisors also dealt with aspects of the 
sociology of teachings internships for teaching, the improvement of manpower 
projections, leadership training, and multi-cultural development. 

The second advisory group consisted of a staff psychologist f rom^ the Equal 
Employment Opportunity Commission (EEOC) and a lawyer who frequently 
r€*presents the National Education Association in teacher selection and 
retention lawsuits. These advisors spoke of models for validating selection 
procedures and the impact of court decisions and EBOC requirements on the 
validation of selection measures. 

The first problem faced by the Panel was the danger of being paralysed 
by the criterion- problem. If recruitment, selection, and retention decisions 
are to be examined, against what standard are they tp be judged? What 
constitutes "good," "competent," or "effective" teaching was, however, a 
question with which other panels at the Conference^ especially Panels 2-6, 
were to be concerned. Therefore, the fenel indicated its concern for , 
intensified research on the basic criterion issues, then moved on to 
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consider research on ^h^ processes involved in recruiting, selecting, 
and retaining (or not retaining) teachers, ' * 

• « 

The Panel did- note, however, that efforts to define the criteria of 
teacher effectiveness in 'terms of student achievement or attitude, go 
beyond present legal reqixif fements for selection and in-service evaluation 
propedures, and may not/ue necessary at the present time for school district 
purboses, The^j3j6w4^r=^eissued American Psychological Association's Guidelines 
for ibfa^ , >.SvaTuation of Standardized Tests , the long-awaited Uniform Guidelines ^ 
on Employee Selection Procedures for federal Agencies, and recent federal 
court decisions all express a willingness to settle for ^content validal;ion, 
i.e., validation i>ased on formal job descriptions and job analyses. 

The decision to avoid seeking that solution of the problem which says that 
• "teaching competence must- equal demonstrated ability to cause desirable 
learning in students" was based on a reality repeatedly recognized by the 
practitioner-members of the Panel: decisions concerning recruitment, selection 
and retention are being made daily in colleges and school systems, often 
otithe basis of highly . sub jective procedures. Anything that can hetp^o 
regularize and rationalize those procedures will be a step forward fo\ 
most school district personnel offices. With improved procedures for l^n^the- 
job practices based on formal job analyses, school districts can wait with 
relative c^lm for the eventual pos-sibility of defining teacher effectiveness^ J' 
in terms of student gain, ' ' V 

The Panel also at^teirtpt'ed to relate the recruitment, selection, and retention 
processes to one another. In m&ny school districts and teacher Institution*;,'! 
the inservice or in-training standards are not systematically linked to 
the selection* and recruitment processes,. Similarly, selection and evaluatic 
are frequently not the main source of information for designing individj^alizyfed 
teacher supervision and inservice education programs. To emphasize 
dependency relationships in ^t,he, total teacher reeruitment-selection-retenti^n 
process, the Panel sought' to relate the approaches to both teacher training 
and the practice of teaching. Nevertheless, teacher training was given j 
less consideration in view of the concentration on that subject by other 
panels, ^' 

Much of the Panel's discussion centered on the role of resea'rch iVi determining 
the values and priorities which school systems place on possible educational 
outcomes. For example, some school systems may. value the maintenance of 
discipline over an open, "caring" environment in the classroom. These 
values may vary widely from one system to another,' One way of determining 
these values might be to look at the types of outcomes ttjiat , are "rewarded by 
the school system. Such an investigation might proceed by describing the 
teaching styles and classroom behavior.s of those teachers who are con-sidered 
to be the "best" in that system, ' . 
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It is likely that shared values regarlding educational goals on the 
part of the potential teacher and th^ school system will g> a long 
way toward solving the problem of teacher retention. This possibility 
^is researchable, as is the question ^f the degree to which Value systems 
'Hiffer among school systems, | ' ^ 

If school syrLems differ substantially in their educational goa.ts, 
research mighL i^.^r-f^ss the problem of whether different criteria for 
teacher selection arc needed. Thus, will persons with certain i»pt"ftudes 
and characteristics do well as teachers regardless of the type of 
school system that hires her? Or do the characteristics of the effective 
teacher depend on the type of system? If different teacher characteristics 
♦ are required in different schoL"* systems, are the characteristics produced 
by the education the prospective teacher receives, pr do they stem from" 
earlier' prei- teaching experience? 

The Panyfel also discussed the effect of the job market On, recruitment and 
selection. When the number of vacancies is far less than the number of 
potential ai)plicants, as is true in 1974, selection at some level is 
inevit/able, ' The selection may occur a.t admission to college, at admission 
to the teacher edn'^-^'-ion program, or at the point of hiring for a 
teacning positiun. Research could be, directed at determining the best 
timo for selection from the standpoint of the educational system as a 
whole, from the stp Jpoint of the colleges, and from that of potential 
teachers. Another researchable question is whether sequential selection 
prjocedures should be used with liberal quotas for college admission/. 
Panel members commented that since the potential teacher often cannot 
l/avo much choice as to the specific position in which he or she will 
Ifach, what must be considered- is the ptoblem of selecting or tra/.ning 
/persons for maximum adaptability and growth pcteential, . - 



Approach 1,1: Analyze. and Improve Methods for Recruiting Teachers 
and Teacher Trainees ^ 

New trends and p^p<;<;iires imoinglng on the teaching profession indicate 
that the recruitmci^ \ -r.^.ess needs to be examined. Recent studies 
indicate that there are at least two candidates for every teaching 
position. Further, teachers and other personnel are now being utilized 
in schools i^i more diverse ways. These changing styles of personnel 
utilizatigp include the use of para-professionals, a variety of student, 
teaching mouels, involvement of 'the local community in the learning 
process, and the development of team teaching. 
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Yet the concepts upon which teacher and teacher-trainee 
recruitment aire based are outgrowths of traditional styles o£ teacher 
preparation and personnel utilization/ Morever, information regarding 
candidates and opportunities has typically been institution-based, that 
is, based upon exchanges between school district personnel offices and 
teacher training institutions. ' 

As a result, the. persons selected and admitted into the profession have *been 
a relatively limited and homogeneous group. Their homogeneity may be partially 
attipibutable to restrictive recruitment practices and to individual's ^ 
career ^.decisions regarding teaching. At present, however, we not have 
information indicating the reasons for the selection or rejection of 
teaching as a vocation by different types of individuals. 

The prQgrams developed within Approach I.l focus on the recruitment process 
in both its quatitative and qualitative aspects. Given the general 
oversupply of teachers, the Panel was not concerned with attracting more 
teachers of all types into the profession. Rather it was concerned with 
identifying what skills might be in short supply (or greater demand) and 
with matching teachers and teaching environments. 

Approach 1.2. ; Analyze and Improve Methods for Selecting Teacher 
Traniees and Teachers ~ 

Selecting entrants into teachefr education or into teaching jobs is now 
.only occassionally a rational process; mare often it is nonsystemat ic or 
haphazard. A considerable body of theory and technology could make 
selection a more valid, objective, and efficient process in mapping such 
a process. Concepts and procedures have been drawn from developments in 
business, in psychological research, in educational research, and in 
educational practice. 

Increasingly useful and sound methods have, been developed for identifying 
the teaching-relevant characteristics of individuals. Significant analyses 
could now be made of the critical demands of particular teaching positions, 
considering specific kinds of schools, subjects, and pupils. Progress 
has been made toward statistical models that can test the '^goodness of fit^' 
of an individual with a specific job. Perhaps of equal importance, 
some procedures have been developed for personalizing the entire system, 
making the teacher an active pafrtner in the whole process of exploring and 
deciding what he or she can do best and wants to do. \ \ 

In practice, these potentially powerful resources have almost nowhere been 
synthesized and used ^n a coherent, systematic way. The rational matching 
of teacher capabilities with the demands of particular teaching jobs cannot 
reasonably be proposed until cert^ain kinds of basic and developmental research 
have been carried out. Tools need to be invented or adapted to measure both 
teacher characteristics and job demands. Research emphasis must be placed at 
this time on identifying situational factors that affect teacher effectiveness, 
and on devising improved procedures for selection in the specific situation 
rather than searching for a universally appropriate type. 
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Approach 1»3» : Investigate the Relationship of teacher Preparation 
Objective^ and Curriculum to Teacher Competency and 
£f f ectiv-fiiessV 



Early studies of teacher education took the form of surveys of current 
programs. These surveys described the then current status and helped 
to identify problems and trends, Subsjequently, the American Council on 
Ldupation attempted to encourage selected institutions ^p develop new kinds 
or prograiAs en^^ analyze" their impact. Several publications appeared as a 
re^Mlt of iheoe ::tud-'es» including one on the use of evaluation in teacher 
cdi^cation. \ By the late 1950<s, there was so much diversity in teacher 
cd3c<jtion programs that effo>-ts were begun to standardize requirements through 
national accreditation, suc\ a<; the effort's by NEA's National Commission 
oh' Teacher Education and F'rof essional Standards in 1959 and 1960. 

In contrast to this movement .toward uniformity, several promising alternative 
approaches have been deVeldped. Auong these are the tutorial and clinical 
program at Northwestern University, the University of Wisconsin intern 
in teaching program, .the Cardoza project in urban teaching, the Stanford 
University teacher intern program, the experimental teacher education 
program at Wayne St/te University, and the personalized teacher education 
program developed p the Te!s<as R&D Center and used in whole or in part in a 
number of teacher /e^v^-t ion institutions in the United States and abroad. 
Another recent development is the trend toward coiqjetency-based teacher educa- 
tion. ,^ ' ' '"^ 

Empirical studiyes of teacher education require an extremely complex, multi- 
faceted research operation that is inherently expensive. Fairly comprehen- 
sive evaluatic/'n studiefe of progranf effects have been possible only at a 
few places, stich as the Stanford^and Texas R&D Centsrs. More such research 
programs are /needed, if the best features (and the worst flaws) of the 
several teacher education models are to be identified. Only sound evaluation 
studies, tracking important program effects into the subsequent performance of 
teachers, will^ makL it possible to prescribe teacher* education procedures 
that have J high probiixly of working well. 

Every majol* kind of preparation program foj^ teajchers should be subjected tc 
a rigorous! objective examination of its effects. Furthermore, each 
significant sub-cor?;>i>ac: t should be empirically tested to determine whether 
it !does v/Hat it is supposed to do. The National Council for the Accreditation 
of TeachetEducation has been calling for thi^ practice for the last three 
years. Little money has be"en assigned to this function, however, and a source 
of revenue for loc^l funding simply is not in sight. The fact that training 
is fund^ through ^ while professional performance is paid for by 
local school systems, riiakes*^ this kind of empirical work a problem that 
cuts across institur.ioti^^i lines, since neither colleges nor school systems 
have funds for such research. Only large-scale, federal funding will make 
it possible to- build genuine quality control into the education of teachers, 
both pre-service and in-service. ^ 



7 



Aptfiroach r,4 



Analyze and Improve M^th^ds for Teacher Placement 
and Orientation 



The practices associated with induction into teaching positions have long 
been stabilized at an inadequa^leveU Often, the newly certified teacher 
moves from the role of student to -that of classroom teacher with a relatively 
brief student teaching experience and a cursory welcome and offer of 
assistance from the supervisor. Beginning teachers are one of a host of 
groups c^ompeting for the time of principals and superintendents as a school 
year begins. ^ 

Some districts extend the welcoming day to ''orientaLion week," assign to 
eachr^ovice a "helping teacher" and allow the beginner some free time for 
-o^^^ting the classrooms of older and presumably wiser colleagues. The 
faculty room coffee break and lunch hour frequently are the most potent 
orientation influences— though not always positive ones. A few districts 
with provision for multi-level staff roles or formal internship programs 
offer a more appealing and presumably more effective introduction to ^ 
teaching. 

These prlcti^s cannot now be alleviated by appealing for implementation 

5,trably better approaches since little research'exists on the 
impact of teacher placement and orientation procedures on teacher satis- 
faction, teacher retention rates, or student growth^ The literature on 
the subject consists of several varieties of personal experiences and 
opinions: Teachers write extremely unfavorable accounts of their first- 
year experiences. A^iministrators complain^ that teachers trained at 
almost any university are ineffective in the innier city schools; they 
agree that the teacher training institutions hay0 failed to prepare their 
graduates for the real world. - ' - / 

Reseai^ch in the a^ea of teacher placement and prepservice orientation could 
be expected to yield information on the costs and benefits to school districts 
of higher teacher retention rates that might result from better assignment 
and pre service training. Would such improved procedures result in fewer 
complaints or formal grievances and reduced incidence of teacher illness? 
Would children learn more form teachers who have b^n carefully placed 
by school administrators in a mutually agreeable situation and offered a 
gradoai, professionally-supervised inductipn into f\ill teaching duties? 
Would more extensive and better planned assistance ^or beginning teachers 
result in less acceptance of sfereotypes about instrjuctional methods and 
student characteristics? In better relatic|iships wi|th administrators and 
parents? Would teachers so assisted be more open to change and innovation 
in their classroom procedures? \ 



Approach 1.5 



Analyze afid In^rov'e the Supervision jand 
Inservice Education, of Teachers. 



The area of teacher recruitment, selection, and retention is vitally 
concerned with proper staff assignment ^nd reassignment as a major 
component of any educational program of ^high quality. Ideally, assign- 
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ments relate directly to staff needs and are influenced by such critical 
factors dls the training characteristics, background, or talents of 
personnel. Actually, however, assignments are too often made in a way 
which merely fills a current need or vacancy and may result in an individual's 
not being fitted to a particular situation.* 

Interj^st in and concern for proper staff assignment goes beyond initial 
placement.' Likewise, interaction between personnel and supervisors continues 
and /intensifies once an assignment is made.,^ ^ 

Evaluation procedures and processes involving reliable measurement instruments 
and systems should become an integral part of this interaction. Judgments 
^hat focus upoii improving service within ^an assigrijnjftnt area and emphasize 
, improving teacher^ pea. f ormance are desirable and effective. Improving 
service and ensuring that personnel growth through cooperatively planned 
and comprehensive inservice programs. As continued growth and evidence of 
successful experience and ei.f ectiveness are recognized, the teachers* need 
for opportunities for some forn of adva-ncement or reassignment becomes » 
apparent. Better planned assignment of personnel to postions. should 
improve sta^f retention and effect:* mess, 

/ , - 

The progr^s developed within this Approach deal with research efforts 
to improve the skill^^ utilization, and advancement opportunities of 
teachers who have already entered the profession. 

Approach 1,6 ; Invest 'l ^te the Decision"*Making Processes Underlying 
I' " jit ion' Changes in Teaching 



The lack of knowledge about the social structure, social psychology, and 
culture of schools ^nd teaching has resulted in a limited understanding 
of the reasons for which people remain in, leave, or make changes of 
positions within ^he profession. Several hypotheses. have been advanced to 
account for teacliers* changing positions. For example, these changes may 
be caused by profound and U3qqperceived dif f erences ^of educational goals 
between teachers to accept students* and parents* standards and goals that 
are different from theirs. Or, the lack of opportunities for promotion 
may induce teachers to leave for higher salaries, greater responsibilities, 
or high^lprofe^ssiona' status. Very few teachers (less than 107.) in public 
schools represent the minority groups that are educated in public schools, . 
Relatively few potential teachers from minority cultures have an opportunity 
to enter the teaching pihof ession. When the cultural background of teachers 
differs widely from Kh^r of t^eir students, either students or teachers or 
both may leave the schuoi. 

Many ^teachers leave the profession for a wide variety of personal reasons, 
e,g,, teachers* low salaries and status, the use of teaching as a **second^* 
job supporting ^ family unit. Some teachers leave the profession when their 
efforts are frustra^-ef^ by inadequate preparation. They may be unable to 
communicate with children, to appreciate other cultures, to understand the 
-learning styles and proble of various types of children, or to diagnose 
the educational, emotional, cultural, or health problems of childrenl 
Finally, teachers may feel frustrated when they do not have an opportunity 
to influence decisions that affect their professional lives. 
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In addition to teachers' own reason^ for changing posit ions^ school gystems 
may move teachers frofn position to position or out of the system; and the , , 
processes involved in these organizational decisions should also be investi- 
gated. ^ / 
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LIST OF APPROACHES AND PROGRAMS 



Improve M^ihods for Recruiting Teachers and/ Teacher ' I.I 



ai Develop panpower Projections for Teaching 
b/ Design Recruitment Programs ^ 
Implement Model Recruitment' Programs 



nalyze and Irp^-ove Methods for Selecting Teacher Tra/inees and 
eachers 



a. Determine Procedures for Specifying Educational Objectives 
Related to Outcomes in the Cognitive, Affectiive, ^and Coping 
Skills of Students / 

b. Detei;mine Procedures for Identifying Desirable Teacher and 
Trainee Behaviors 

c. Impi^ove the Collection and Analysis of Qualifyij^g (Pre-^ 
Selection) , Data - / / 

d. Design Efficient Procedures /foi^ Making Selection Decisions- 




if 



3. Investigate the P^Iationship pf Teacher Preparation Objectives 
and Curriculum to Teacher Competency^ and Effectiveness 

J I 

U Investigate General Education Courses 

.3. Investigate Professional/ Education Courses 
c. Investigate Courses in iha Subjefct Matter ^'ield 

Id. Investigate Means for In^roving Student Teaching 

le^ Investigate Alternative Certification Routje's 

/[ . / 7 

A.' Anal^z^ and Improve Methods for Teacher Placement and Orientation 

. ^4s/igh*-d<id Test IIcw Teacher Placement P/tograms 
. Design ^n^Test New, Teacher Orientation Programs 
c. /:^xaminy Organizational and Individual /Decision-Making 
, /Processes in the I^lacem^t and Orientation of Teachers 



1. 1.1 
1.1.2 

'1.1.3 



1.2 
1.2,1 

1.2.2 
1.2.3 
1.2.4 

'l.3 



1.3.1 
1.3.2 
1.3.3 
1.3.4 
1.3.5 



1.4 

1.4.1 
1.4.2 
1.4.3 



nd If^acher Tra-ii/a^p 



/ 

/ 

/ / 



/ 



e and Improve tfhe Supervision and Inservice Education of 1.5 



ers 



Analyze and Improve Inservice Training Activities 
Synthesize an'yUs.e Cuprent Knowledge Concerning the 
Evaluation Proceiss ' / 

Develop and ilvalWte Models of Teaching as a Multi-Level 

• - ^ // / 



1.5.1 
1.5.2 

1.5. "3 



ofession 

/ 

I / 

/ 



/ //' 



/ 



I r 



Investigate the Decision-Making Processes Underlying Position 
Changes in Teaching 



a. Investigate Personal Decisions by Teachers and Trainees 
Resulting in Position Changes 

b. Investigate Organizational Decisions Resulting in 
Position Changes by Teacher or Trainees 

c. Design and Conduct a Series of Studies on M^ral Decision- 
Making Processes in School Organizations 
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APPR0ACH^2J : RESEARCH ON HUMAN INTERACTION IN EDUCATIONAL SETTINGS 




Teacher education, 

training, and self* 

development 
I 




""Interaction: 
Teacher behavior 
& student behavior 


* 


Learning and 
other ojitcomes 


k ^ 












Plans for teaching 
and teacher charac- 
teristics 




1 — ^ — 1 

I Setting 

1 characteristics 
1 and contexts 




Student 

characteristics 



APPROACH 2.2: 



RESEARCH ON TEACHER EDUCATION 



Teadier 

Characteristics 



z 



.Plans for 
teaching 



Interaction between 
education instructors 
and adults learning 
to be teachers 




2^ 



Real or simulated 
Interaction betweerf 
teacher trainees 
and pupils 



Knowledge and 
skillsjearned 
by teacher 
trainees' 



Skills & Procedures 
for analyzing inter- 
action to provide 
feedback 



APPROACH 2.3:' METHODOLOGICAL ISSUES 



Research on Human Inter- 
action & Teacher Education 



# 




1 










1 


Issues of Statist- 




Errors of 




Research 


ical Conceptualization 




Encoding 




Communication 
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SUMMARY 



The [panel on Teaching as Human Interaction organized its 
worK\around three major needs: 

^1, TheXneed to create knowledge about and an understanding^ 

of rhe process of teacher-pupil and pupil-pupil interaction 
. during teaching and learning, 

2, The need to create knowledge and methods to improve . 
teacher educat.ion for teaching as human interaction, 

3,. The need to improve the methodology and instrumentation 
for doing research on teaching as human interaction 
as well as the methods of communicating that research 
to^ educational practitioners. 

DISCUSSION ^ 

When research on teaching is viewed as human interaction^ 
it can be represented by the six classes of variables which 
are shown in Figure 1, 



(1 ) Teacher . education , 
training, and self- 
development 



( 2 ) Interaction : 

Teacher behavior 
& Student behavior 



(3) Learning & 
other 
outcomes^ 



(4) Plans for teaching 
and teacher charac- 
teristics 



(5) Setting 

characteristics 
and contexts- 



X6) Student 

character- 
istics 



' Figure 1 

Main Classes of Research Variables ^ 

Panel 2 included any research on. teaching that analyzes the 
interactive .behavior of pupils and teachers shown in box 2 of 
Figurav^l. Thus, research on the interaction itself , and 
the associations of interaction variables with student learning 
and other outcomes, with student characteristics, with setting 
characteristics, with making plans for teaching, with teacher 
characteristics, and with teacher education are the concern of tuis 
Panel, ^ 

The analysis of human interaction and especially teacher-pupil 
interaction is of concern to this Panel in two ways: First, 
it is a way to discover knowledge about how the educational 
growth^and development ' of pupils can be improved; second, the 
analysis of interaction is a method of educating and training 
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inexperienced teachers in preservice professional programs 
as well as experienced teachers who mast adapt new knowledge 
about teaching to their classrooms ^heir pupils r ahd their 
personal style of teaching. / ) 

The Panel's discussion began with the pbservation that we 
have made considerat^Le progress in research on teaching 
during the past few decades. This has included the invention 
and refinement of procedures for analyzing human interaction. 
But too much of the research is irrelevant to pressing 
problems, such as .he evaluation of teacher effectiveness, and 
most research fails to be implemented in preservice and inservice 
teacher education. One reason may be that the validity of 
knowledge statements about teaching is unknown until the 
question of how teachers use this knowledge is investigated. 
To improve education, knowledge about teaching must be under- 
stood, selected and adapted by teachers and educators in the 
classrooms and schools. Another view, expressed early in the 
work of the Panel, was that analysis of research design and 
methodology should be prominent in a review of research on 
interaction processes. " , 

It was^ in this fashion tht the report of Panel 2 gradually 
came to regard jt3, ^-otal plans as having three major components: 
first, to identify the kinds 6f knowledge that research on 
interaction processes can produce; second, to show -how the 
utility of this k^nowledge can be tested by research on teacher 
educationfi^ and third, to make, recommendations about research 
methodology as a guide for those who investigate interaction 
processes. ^ These thr.ee components constitute the proposed 
research Approaches in this Panel report. The following 
discussions focuses on these Approaches, and the Programs and 
Projects which are organized under the Approaches. 

^ ^ .^^ . 

Approach 2.1; Research on Human Int^eraction ^.fe^i^ 
Educau xonal Settings ^ 

This first Approach sets as its goal the creation of knowledge 
and understanding of the process of teacher-pupil and pupil- 
pupil interactioiiJr irlng teaching and learning. Five programs 
have been' outlined as Wctys to acheive this goal. 

The first Program, Patterns of Teacher-Pupil Interaction (2. 1,1), 
aims at increasing our knowledge of the interaction processes 
which occur as a result of teaching and learning activities. ' 
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This knowledge can be developed if research progress j.s 
made in the analysis of longer chains of events, in separating 
events according to instructional purposes, in conceptualizing 
curiiculum-specif ic interaction patterns^ and in making 
comparisons of the explanatory power af different encoding/ 
decoding systems. 

Under this program four projects are offered as examples 
of ways to achieve the program goal. In Project 2.1.1.1 a data 
bank wpuld be created for records of classroom interactive 
behavior, and would be designed to overcome' present difficulties 
in comparing different systems of analyzing interaction 
f)rogresses. The second Project (2.1.1.2) in this program is 
concerned with the natural history of interaction patterns 
in classroom groups. The goal is to learn more about hoy 
patterns of interaction change with the passage of time and 
the influence of group experience. This project is followed 
by 2.1.1.3 which would seek to develop knowledge and understand- 
ing of the ways in which teacher behaviors influence pupils and 
how pupil behaviors influence the teacher. Some of the 
activities aim at identifying: (a) how teachers perceive 
and conceptualize pupil behaviors, (b) how teachers' perceptions 
of pupil behaviors influence their chc^j^ce or use of different 
strategiea or tactics, and (c) how teachers ' ^perceptions of ^ 
pupil behaviors influence th^ir expectations concerning pupil 
ability, attitude, and performance. The final Project (2.1.1.4) 
in this Program suggests the examination of different inter- 
action processes as they are associated with A^arious models -of 
teaching and strategies of instruction. The purpose of the 
project would be to collect interaction data necessary to 
distinguish among different teaching models or instructional 
strategies . 

The second major Program, Relationships Among Interaction 
Processes, Context and Setting Variables, and Pupil Characteristics 
(2.1.2), under the first approach was developed on the under- 
standing that 'interaction processes will differ depending • 
on s'fehool climate, curriculum, classroom equipment, and the 
composition and size of the pupil population. Four projects 
were outlined. The first Project (2.1.2.1) is established 
to determine the effects on interaction processes of 
differences in educational settings. The most urgent need 
is for information which teachers can use constructively. 

^With regard to racial, ethnic, religious ,SES , and sex differences; 

*the most urgent need is to distinguish between pn^blerfis 
which can be influenced by the different tactics ^available • 
to teachers and those that can't. The second Project (2.1.2.2) m 



-A 



this Program seeks to determine the effects of classroom 

this^^^o^^^^^^^?''°''^^^^^ °^ interaction. Studies falling into 
;ho^.Kf • ^ concern themselves wii;h variables such Is 

the physical features of the classroom: siz^, degree of 

edScf^?o;.i^^^J^"^' the presence and use of 

^ro^Jc^ S f2'"f pNf''^^ television or teaching machines. .In 
hp?d^^n J I ^- ^ determine associations 

?nit;u2ttoi^''^f immediate purposes of • 

instruction Investigations ori this topic are- concerned 
™f ^ ; natural cycles of learning^ and instruction which 
• ■ teachL npr^^;? intervtion, for pupil perceptions, and for 

teacher perceptions. The last Project (2.1.2.4) in this 'Proaram 
looks at the influence of the curtriculum and of the maki Ud of 

tMs'oro?;^.^°>?fj'°" °" interaction processes: ^ItSd^L L 
this project will be concerrie^ with class size, grade level 

:S"otheTSr'-'i?"' ""^'^'"^ clas;.?Jckground ' 

as wpn LT'^^^f asspciated with, pupils in classrooms, ' 
as well as curi^iculum variables. - ' - ' 

vK-^I;^'''^ Relationships Among Teacher 

thL'fproc;es?proV°?.^^°^^""^"' ^"^ ^"Pil Perceptions of 
^hP Lfrpi ! (2.1.3), in the first Approach focuses on 

the development of knowledge and Understanding of the 

for ?n2?;n^?-'^"'°"^.^^^''^^'" ^^^^^^^^^^i^^i^S' teacher-made plafvs 
.for instruction, interaction processes, and pupil perceptions - 
of these processes. The goal of^ the Program is *o dJter^?ne 
the ways an which the beliefs, attitudes, experiences, ^Jsical 
o^ftpJn""'?'-"?^ attribi^ of\eachers Jf?ect ;he 

patterns of interaction. In*the .firs^ Project (2.1 3 1) 

-lulcTfr/t"^\''^^^ ^° knowlege of the ways'In which 

?r?d5SJ^^S?^^ purposes and beliefs about teaching result 
w?th1h ^his'^Prna?;^''^''"f^°^ classroom interaction. Projects 
hii^pf= ^ Program would be concerned with how the teacher's 
inttlr^ purposes result in identifiable patterns of 
W^ctuanvP^^."'''M?°" ?hese beliefs and purposes are modified 
by actual events m the classroom. The Program's second Project 
U. 1.3. 2), aims. to develop knowledge and understanding of the 
ways m which teachers' beliefs and feelings about pupiJs 
■ie n^?d''to'?^^''^K^?-°" patterns. Special attention Seeds to 
be paid to the ability of a teach^ to ide;itify differences 
between i^idividual pupils, and to the ability'of a tlac^eJ 
to ---°^ate indentxfied pupil differences! The fin^Jlroject 
knntihrrl ^ ! ProgranT focuses on the development^ of 
^lacipr^^h^:^ understanding of the relationships between general 

occu? In ^hf^ ^"^ patterns of interaction which 

occur m the classroom. 
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Program 2.1.4 focuses on the relationship between teacher- 
pupil interaction and the effects of the interaction on pupils. 
The history of research in this area over the last decade 
has pointed out the conceptual and measurement problems of 
trying to relate single interaction Variables with student 
achievement. This Program suggests seven project areas which 
can be used to overcome the deficiencies of past research. 
The first Project (2.1.4.1) aims at the,d6sign, development 
and evaluation of measures* of learning/ outcomes for use in 
process-product research.- In additionlto the development of 
closed environment units for doing interaction research, other 
measuring instruments need to be developed, such as measures 
of positive attitudes toward the teacher and toward learning 
activities, schemes for observing persistence or lack of 
distraction, ways to measure the pupil's level of aspiration 
with regard to learning, etc. 

Project 2 (2.1.4.2) in this Program continues the search for 
intervening variables of classroom interaction by looking at the 
immediate effects of teaching on the reactions of the pupils. 
A number' of techniques may be recommended for tlri:5^T>urpose 
including those involving stimulated recall apta intensive 
intjerviewing of pupils for salient experienC'6s in teaching, 
cc5nstruction of criterion tests immediately after the lesson, 
.and experimental research in which criterion tests are keyed 
to variations in curricular treatment. Project 3 (2.1.4.3) 
shifts its Attention from the immediate effects to the long-term 
effects of teaching on the reactions of pupils. Good designs 
for this Program would feature utilizing longitudinal processes 
and measures of long^-term effects. ^ 

In the fourth Project (2.1.4.4),, the focus shifts to an ^ 
analysis of previous completed research studies as a means 
of validating the process-product relationships reported in 
those studies. Reviews of process-product studies in ^e 
literature have identified a number of variables which sefem 
to be related to pupil achievement gains. The purpose of this 
Project will be (a) to develop 'low-inference instruments to 
measure these variables, and (b) to stuqly the relationships 
of these measures not only to achievement, but tb other 
outcome measures. Project 5 (2.1.4.5) in this series is designed 
to test, through experimental research, the validity of 
assumptions, beliefs, or theories about the effects of particular 
patterns of classroom interaction. 
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Project 2.1.U.6 will seek to determine the relationship of 
classroom interaction to individual pupil ^ains. And the 
final Project (2.1.2.7) in this Program is focused on 
identifying unique interaction patterns associated with 
different types of learner outcomes. The data base tor 
this Project would be a set of videotape recordings of all 
the interactions during the teaching of the same brief unit 
by a sample of secondary gchool teachers, plus profiles 
of pupil gains on a set of measures of different outcomes 
and data on appropriate context variables. 

The fifth Program, Research on the Determinants of Teaching, 
Interaction Processes and the Effects of Teaching (2.1.5), 
is aimed at explaining the _ relationships between school and 
classroom contexts and pupil characteristics by developing 
explanatory theories of teaching and examining different 
arrangements of independent and dependent variables. In 
Project 2.i.5.1, the goal is to develop empirically-based, 
explanatory theories of teaching that accommodate the 
findings of prior research. Project 2.1.5:2 suggests that 
multifaceted studies of teaching as human interaction be 
used to*"examine many different arrangements of independent 
and dependent variables. Some of the pupil variables to be 
considered would include: pupil ability, SES, racial background, 
native language, self -concept, academic optimism, internality, 
and perceptions of teaching behavior. Setting characteristics 
would include characteristics of the school, classroom, 
and community, as well as the dynamic context of the interactive 
behavior. Teacher characteristics would include personal and 
professional characteristics, training, and the tendency to 
use lesson plans. 

f 

Approach 2i2 - Research on Teacher Education 

This Approach builds on the knowledge developed in, research 
on the process of teaching as human interaction. In the first 
Approach (2.1) the Panel proposed a research program designed 
to discover associations among six classes of variables. 
These were detailed in Figure 1. This second Approach is 
organized around additional classes ^of variables as depicted 
in Figure 2. 



(6) Teacher 
Characteristics 

I? ^ 

(1) Interaction 
between education 



instructors and 
adults learning 
to be teachers 



(2) Real^or'^TniuTa ted 
interaction between 
teacher trainees 
and pupils 



(7) Plans for 
teaching 



(3) Knowledge and 
skills learned by 
^ teacher trainees 



(4) Setting 
Characteristics 



(5) Skills and Proce- 
dures for analyzing 
interaction to' 
provide feedback 



^ Figure 2 

Classes of Teacher Education Variables 



The major point in this Approach is that research should produce 
knowledge about teaching and that. this knowledge can be utilized 
by teachers. Competent research on teacher education can address 
this point by (a) helping to produce more effective beginning 
teachers / (b) helping experieiiced teachers upgrade their 
teaching more effectively, and (c) providing a letting in 
which we test the utility of knowledge about teaching. 

In thinking about research on teacheJ^^e^cation , the Panel 
was concerned with five questions: 

(1) H6w do teachers think about interaction and 

make decisions concerning their own participation? 

(2) How can te^achers improve^ their own interaction? 

(3) How can the information, if it is to be used as. 
feedback to a teacher, be improved in' terms of , 
its nature, amount, ^nd timing? 

m) How can computer-based systems be adapted to 
teacher education? 

(5) How can educators best respond to the demands or 

laws which affect the evaluation of teachers? - . 

The Panel also offered four criteria for guiding the 
development of such research: 

(1) ^ Specific teacher training objectives should be 
'stipulated in behavioral terms. 

(2) Objectives should be measured in reliable and valid- 
interactive contexts. ^ 
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(3) Specified training variables, procedures, materials, 
sequences, and so on, should be replicable. 

(4) The research should be designed to insure 
validation of results by including effects on students. 

Three Programs are offered to deal with the issues involved 
in doing research on teacher education vis-a-vis human 
interaction. 

Program 2,2. 1, How Teachers Think About Interaction, is 
designed to e-xamine the phenomenon that teachers are likely 
.to modify their own interaction with pupils after analyzing 
their own interactions. These Projects would* include 
studying the relationships between training teachers in the 
discrimination of interaction patterns and the cognitions 
these teachers employ in sensing and perceiving this 
discrimination; investigating the ways in which teacher trainees 
act and react within different interaction patterns; and 
designing and evaluating various decision-making models _ 
which apply to choices a teacher makes while interacting with 
pupils. Program 2,2*2 deals with the topic of computer-based 
systems for teacher education which suggests research that 
will examine* the capacity of an adult to receive, process, 
and act on information while actively engaged in learning 
interaction skills. Program 2 •2,3 suggests that teacher 
training programs could improve 'their training functions if 
they employed a systems development approach to their work. 
Research in this area would include the development of a 
rapid feedback model for teachers during their interaction with 
students, the development of a feasible paradigm for training^ 
and maintaining observation skills of observers Within the 
* c^bntext of both perservice and inservice teacher training 
programs*, etc. Project (2,2,3,2) suggests studies to examine 
the utility of knowledge about teacjiing' and to evaluate the 
extent to which "motivated adults can implement this knowledge 
in their teaching. The final Project (2 ,2. 3 ,3) in this series 
focuses on the development and .evaluation of services for , 
school districts wl:)ich are required by law to evaluate their , 
personnel in terras .of effective human interaction, ^ 

Approach 2,3: Issues of Methodology, Instrumentation, and 
and Professional Communications \ 

Prior to developing its .three Programs for this Approach, 

the Panel spent a great deal of time developing a statement 

about the areas of agreement on the methodological issues. 

The areas about which the Panel reached agreement are as follows 



Programmatic/ cumulative research that may make use of 
both laboratory and field studies should get top funding 
priority. 

Studies should stress multiple measure^ of learning outcomes 
in addition to subject matter achievement . 

Researchers should routinely plan to check for non-linear 
relationships . 

In addition, they should check for the statistical 
interactive effects within both independent and dependent 
classes of variables. 

Other design features should be accounted for, e.g. 
systematic measurement and control of variables and the 
replication of findings from one type of teacher, student, 
or setting to different types. 

Analyze how learning gains are distributed across different 
kinds of learning . 

Use care in selecting residual gain measures o f student 
outcomes based on raw pretest and posttest scores. 

Include both high and low-inference measures of process 
behavior. 

Randomly assign or match classrooms on relevant student 
variables, particularly initial scores on the criterion 
tests. 

Use a large sample -pf teachers in field .studies, and a 
wi de range^ of behaviors in laboratory experiments. 

a rationally selected rather than a randomly 
ilected teacher sample. 



Collect enough data to insure reliability and validity . 

LongVterm studies are to be preferred over short-term 
studies . 

MonitoV the implementation of the study through observations. 
Control Yor experimental participation effects. 



\ 
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Insure ade^quate variance across classrooms on measures 
of interest 
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(17) Insure that the' teacher behavior Qf interest is, in fact, 
• stable within clusters of data. 

(18) Collect and preserve' the original sequence of classroom 
interactions and data on how they were initiated. 

(19) Devise scoring systems which allow direct comparisons 
of data/ e.g., convert raw frequencies to percentage 
scores. * ' . 

(20) Use -project goals to make decisions about what to 
measure, and how to measure it. * 

Program 2.3.1 calls for commissioning a task force of qualified 
researchers to clarify and illustrate the issues relatedvto 
the choice of units of sampling, populations, universes, and 
degrees of freedom in the analysis of interactive behavior. 
The first Project (2.3.1.1.) proposes the examination of* the, 
problems connected with sampling and generalizing from samples. 
For example, a question to be answered concerns the unit* o-f 
sampling — the teacher, the student, a behavior episode, etc. 
A second Project (3.3.1.2.) proposes examing the related 
problems connected with defining a unit of behavior; and th'e 
final Project (2.3.1.3.) seeks to examine the problems 
connected with studying time series, chains of events, and 
models for conceptualizing c};^ains of. events as chey are used to 
represent human interaction. 

Although recognizing the problems in this area. Program 2,3.2 

suggests efforts to investigate the nature of errors during 
encoding procedures, and to develop a model for understanding ^ 
errors that can serve as a guide for different encoding systems 
and can show how to demonstrate the effects of errors in the 
analysis of human interaction. More immediately. Program 2.3.3 
urges developing the^ means for assuring communication and the 
sharing of data, methods, and substantive results concerning 
research on teaching. At present, no adequate means are 
provided for gaining access to the results of the large number 
of research efforts which are being produced every year. 
Therefore, the first Project (2 . 3 . 3 . 1 . ) calls for support of an 
ERIC Clearinghouse for Research on Teaching so that educators 
can. gain access to literature concerned with research on 
teaching. The second Project *(2.3.3.2.) calls for the commissioning 
of regular reviews of research dealing with the processes, 
causes, and effects of teaching. Project 3.3.3.3 . suggests 
the establishment and support of a Journal for Research on 
Teaching, and Project 2.3.3.U suggest^ the commissioning^ of 
one or more conferences concerned with standards for scientific 
publication in research on teaching and allied fields. The 
final Project (2.3.3.5.) of the series calls for the establishment 
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and support of a data hanlk for basic data from studies in 
teaching. Such a bank Wuld solicit the deposit of data 
from studies of teaching/ already conducted and would specify 
the standards for depos|^t of those data, j 
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LIST OF APPROACHES, PROGRAMS, AND PROJECTS 



Approach 2.1.; Develop knowledge and understanding of human 
^ interaction within educational settings. 

Program 2.1.1.: Develop new ways to conceptualize and 

analyze patterns of teacher-pupil interaction. ^ 

Project 2.1.1.1. - Design and create the capability of 

/ establishing a data bank of recorded 

interactive behavior complete with * 
associated paper-and -pencil test' data. 

Project 2.1.1.2. - Examine the cycles of development through 

which interaction patterns mature. 

Project 2.1.i;3. - Develop knowledge and understanding 

of the ways in which teacher behaviors 
influence pupils and in which pupil behaviors 
influence teachers • 

Project 2.1.1.4. - Examine the different interaction processes 

associated with various models of teach- 
ing and strategies of instruction. 

Program 2.X.2.: Examine relationships among interaction 

processes, content \and setting variables, 
• ' and pupil characWristics. 

Project 2.1.2.1. - Determine the effects on interaction 

processes of differences in educational 
\ settings. 

^^oject 2.1.2.2. - Determine the effects of classroom contexts 
^C^^ on the processes of interaction. 

I 

Pronect X 1.2.3. - Determine associations between interaction 

processes 'and the immediate purposes 
of instruction. 

Project 2.1.2.U.\- Determine the effects of variables 

\ concerned with fhe curriculum and with 
\ \he compostion of the pupil population 
on^ the processes of interaction. 
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Program 2,1.3.: Develop knowledge and understanding of 

the relationships among teacher characteristics , 
teacher-made plans for instruction/ interaction 
processes f and pupil -perceptions of these 
processes # 

Project 2.1.3.1. - Develop knowledge of the ways in which 

specific teacher purposes and beliefs 
about teaching result in identifiable 
patterns of interaction. 

Project 2.1.3.2. - Develop knowledge and understanding 

of the ways in which teacher beliefs 
and feelings about pupils influence 
interaction patterns. 

Project 2.1.3.3. - Develop knowledge and understanding 

of Relationships between general teacher 
characteristics and the patterns of 
interaction which occur in the classroom. 

< 

Program 2.1.4.: Develop knowledge and understanding of the 

relationships between teacher-pupil interaction 
and the effects of the interaction on pupils. 

Project 2.1.4.1. - Design, develop , and evaluate measures 

of learning outcomes for use in process- 
pjroduct research. 

Project 2.1.4.2, - Determine the Ijranediate effects of teaching. 

on the reactioife of pupils. 

Project 2.1.4.3. - Determine the long-term effects of 
) teaching on the reactions of pupils. 

Project 2.1.4.4. - Validate the results of previously 

reported' empirical studies of process- 
product research. 

Project 2.1.4.5. - Provide empirical validation for widely 
^ ^ hel'd or well-supported assumptions or 

theories aboub the effects of particular 
patterns of classroom interaction. 

Project 2.1.4.6. - Determine the relationship of classroom 

interaction to individual pupil gains. 

Project 2.1.4.7. - Identify unique interaction patterns 

associated with different types of 
outcomes. ^ *^ 



<^ SG 



ERIC 



14 



Program 2.1.5. : 



Project 2.1.5.1. 



Project 2.1.5.2 



Determine the complex and contingent relation- 
ships among the determinants, processes/ and . 
effects of teaching through studies involving 
three or more variables classes. 

Develop empirically-based, explanatory 
theories for teaching that accommodate 
the findings of prior research. 

- Examine many different ' arrangements of 
independent and dependent variables in 
a multifaceted study of teaching as human 
interaction. 



Approach 2 *2^ 



Df^vf^iop knowledge a p H methods nnefnl in th^ imaerstand i nq 
and improvement of teach er f^ducation. 



Program 2.2.1, 



Project 2.2.1.1, 



Investigate how teachers think about interaction 
and make decisions about their own participation, 

- Study the relationships between training 
in the discrimination of interaction 
patterns and the cognitions involved in 
sensing and perceiving these discriminatiOTS, 



Project 2.2.1.2. - 



Inves^igage the ways in which teacher 
trainees act and react within ddfferei^t 
interaction patterns. ' v 



Project 2.2.1.3. 



Program 2.2.2. : 



Proje^Gt 2.2.2.1. 




- Design and evaluate various decision- 
making models which apply to choices al 
teacher makd^ while 'interacting with pdpils. 

Conduct basic research in the capacity of an 
adult to receive^ feedback information while 
interacting with pupils. 

- Conduct laboratory psperimentation on 
the capacity of a inbtiV^t,ed adult to ^ 
receive, process, aM^ct on different 

•kinds of feedback infm'mation while * , 
learning how to crea>te desired patterns 
of interaction. 



Project 2.2.2.2, 



- Explore the need for autonomy while 
learning progressively more complex 
interaction skills. 



Program 2.2.3. : 



Explore systems development for teacher 
education in preservice and inservice programs, 
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Project 2.2.3.1. : 



- Design, install, evaluate, and then 
expand , the services of a regional 
teacher education laboratory to provide 
computer assisted training systems to 
school districts and teacher training 
institution's within reach of telephone 
networks. 

Project 2.'2.3.2. : ^'With the resources of a teacher 

education laboratory, examine the utility 
of knowledge about teaching and evaluat e 
the extent to which motivated adults 
can implement this knowledge in their 
teaching. 



Project 2.2.3.3. 



Develop and evaluate services for 
school districts which are required 
by law to_ evaluate their personnel 
in terms of effective human interaction. 



Approach 2.3. 



Issues of methodology, instrume ntation, and 
profess ional communication. 



Program 2.3.1. 



Commission a task force of qualified researchers 
to clarify and illustrate the issues related to 
choices of units of sampling, populations, universes, 
and degrees of freedom in the analysis of 
interactive behavior. 



Project 2.3.1.1. - 
Project 2.3.1.2. - 
Project 2.3.1.3. - 



Examine the problems coftnected with 
sampling and with generalizing from samples. 

Examine the problems connected with 
defining a unit of behavior. 

Examine problems connected with studying 
time series, chains of events, and models 
for conceptualizing chains of events. 



Program 2.3.2. 



PrcJgram 2.3.3. 



Investigate the nature of errors during encoding 
procedures, and develop a model for understanding 
errors that can serve as a' guide for different 
encoding systems and can show how to demonstrate 
the effects of errors in the analysis of human 
interaction. 

Develop the means for assuring communication 

and the sharing of data, methpds, and substantive 

results concerning research on teaching. 
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Project 2.3,3,1, - Support: an ERIC Clearinghouse for 

Research on Teaching. 

Project 2. 3. 3. 2, - CoimnissicSn regular reviews 

of research on the processes^ causes, 
and effects of teaching. 

Project 2, 3. 3. 3, - Establish and support a journal for 

research on teaching. 

Project 2, 3.3.4. - Conunission one or more^ conferences 

concerned with standards for scientifUc 
publication in research on teaching and 
allied fields. 

Project 2.3.3.5. - Establish and support a data bank for 

basic data from studies of teaching. 
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SUMMARY 



The Panel on Teaching as Behavior Analysis organized 

their suggested research programs under eight approaches: 
* 

1. • Increase the utilization of applied behavior 

analysis in the preservice education of teachers, 

2. Develop procedures for installing and maintaining 
effective teaching and teacher education techniques 
and systems in new settings • 

3. Examine procedures for the development of more 
^^^ffective teacher performance through teacher 

training^ and for the development and improvement 
of existing teacher support systems • 



4, Develop, through empirical research, systematic 
procedures that can be used to define the goals 
and objectives of educational programs. 

5, Develop a community education training program 
, for parents. 

6. Develop and evaluate measuo^es of teaching processes 

5. and outcomes. \' 

7. Develop and test methods by which teachers and 
teacher-training institutions can make themselves 
more accountable for their performance. 

3' Develop criteria for funding educational research 
which can ensure outcomes of direct relevance to 
teachers* instructional objectives, and which 
are acceptable to the community institutions in- 
volved. . 

DISCUSSION 

The objective of Panel 3 was to design a program of research 
that can improve teacher traijiing and teaching effectiveness 
by further developing and' utilizing that set of educational 
techniques* known as applied behavior analysis. 
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Applied behavior analysis is fundamentally problem oriented., 
Coitsequently , the events and subjects of study within this 
fieloNare chosen because of their social importance rather 
tha}i because of their importance to theory. The conventions 
of behavioi\analysis require that it deals with physical 
events that are^'"precisely measurable, and that it can claim 
to have analyzed a phenomenon to the extent that it can 
exercise control over the phenomenon in ways that can be 
replicated by others. These self-imposed requirements mean 
that applied behavior research evaluates the effect of specific 
procedures in a way that directly relates process and outcome 
variables. Further / the Panel agreed that behavioral procedures 
are judged effective to the extent that they: a) achieve 
specified goals; b) are replicable; c) are preferred by consumers; 
d) are practical — including economically — in the educational 
system and community in which they are applied; and e) are 
disseminable . * * 

Empirical studies of behavior change (teaching) procedures 
that fall under the heading of applied behavior analysis 
have had a relatively brief y^t productive history. Based 
on a number of rationales published in*' the 1950'S/ a rapidly 
expanding collection of empirical studies has developed 
systematic procedures for changing behavior through the use 
cxf contingent reward/ stimulus control ^ environmental design / 
social modeling, and systematic desensitization . 

It was a generally held working assumption of the Panel that 
in spite of (or perhaps because of) the vigorous development 
of behavior analysis in education, it iS; at present, a 
technology that is sparsely utilized in the training of 
educational personnel or in the teaching of students. Because 
of this perspective, the several approaches that were identified 
for development tend to focus on the need for research that will 
contribute to the utilization of existing technology rather 
than research on basic concepts and methods. The most notable 
exceptions to this general rule are in the areas of measurement 
and consumer satisfaction where more basic kinds of developmental 
work are called for by the Panel report. 

Whether the rules and conventions that define applied behavior 
analysis are narrow and restrictive, or are directly responsible for 
the effectiveness of the approach, is an interesting si±)ject for 
academic debate. The various members of the Panel hold 
differing views on the issue. There was, however, agreement 
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that the immediate practical needs of teachers and teacher 
trainers require the products of a coherent research plan 
shaped by those needs rather than the occasional and 
'"fortuitous benefits of unorganized investigations. The 
eight approaches which the Panel identified for development 
reflect this pragmatic concern for the current needs of educators, 

» Approach 3.1 — Increase the utilization of applied behavior 

analysis in the preseryice education of teachers : 
The educational technology developed by. applied behavior 

^ analysis has particular relevance for teacher training programs, 

'The utilization of this technology in teachel: preparation 
is discussed in three separate and distinct areas: 

1, As substantive content (i,e,, increasing the amount 
of information trainees receive about behavior 

* analysis in education) . Now that a practical 

technology of classroom behavior, anal'ysis exists, 
effective ways iriust be devised to make it ,a part 
of established 'teacher training programs. Further, 
,and perhaps more important, ways must be devised to 
experimentally evaluate the effects of including 
behavior analysis training at -the preservice level 
on the ini.tia'l classroom performance of teachers. In 
short, the' question to be answered is: What 
behavior analysis techniques can be taught to trainees 
that will be most beneficial to them as teachers? 

2, As a technique for developing trainees * personal-social 
skills (i,e,, to help trainees learn better ways of 
dealing with personal stress and tension) , Specific 
programs in the area of personal-social skills training 
involve the evaluation of functional relationships 
between teacher performance and specific training in 
anxiety and depression as well as training in the use 

of social praise and other specific teaching techniques, 

3, As an instructional methodology that can be used in 
teaching other professional and general education 

^ courses. The need for expanded research on the use 
of behavior analysis as a methodology for preservice 
training is exertipl^f ied by recent studies that have 
provided some extremely promising suggestions for the 
development of improved training strategies. Three 
particularly promising areas are: a) analyses of 
the effects of feedback to trainees, b) modeling, or 
role-playing, techniques, and c) analyses of the 
effects of PSI (Personalized System of Instruction) 
courses in a variety of content areas. 
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Approach 3.2 — Develop procedures for installing and maintaining 
effective teaching and teacher education techniques and systems 
in new settings , This Approach focuses on^^the parallel questions 
of transferring experimental programs from laboratory school to 
classroom and maintaining the effectiveness of innovative 
techniques and systems once they are installed. 

The experimental literature on the dissemination and maintenance 
of innovation in education is' extremely limited. Ei<perience 
with Follow Through programs and the model program for 
delinquent children (Achievement Place) points out some of 
the difficulties inherent in dissemination. 

The experiences of Fallow Through indicate that when procedures 
first tested under laboratory school conditions were moved 
into the field on a wide-scale basis, they had to be revised 
and supplemented to include (a) procedures that were more 
readily taiight t^ teachers, (b) the training of teachers on^ 
a continuing basis, (c) the monitoring of both teaching 
procedures and on-going student progress (quality control) 
to guide training and maintain performance, and (d) the develop- 
ment of local support systems (administrative support, union 
support, parent support and local monitoring and training 
procedures) . 

A recent report iDn'the dissemination of the Achievement Place 
;nodel for home-like treatment centers for pre-delinquents 
further demojristrates the difficulties of transitions froiti 
laboratory school to field. Program procedi^res had to be 
redesigned so they would function more readily (i.e., be 
more easily trained for and followed) , and a quality-control t 
feedback system was required to help maintain and improve 
the exported systems. 

Other recert reports on the maintenance of innovative systems 
suggest that only where the original "great m^n" remained - 
involved did an innovative procedure survive over any length 
of time. Research on the maintenance of gains when children 
are moved from experimental settlings back to regular class- 
rooms shows that explicit procedures are needed to ensure 
maintenance of a behavior change. Extrapolation from this 
finding would suggest that changes produced in teacher 
behavior through a special intervention program might be lost 
over time if supportive f eedbac.k > was not provided by principals, 
another teacher or supervisor, or by data on student behavior. 
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These findings indicate that a specif icVechnology must ' 
be developed that can improve both the dissemination and 
the maintenance of innovative programs and\^rocedures . 

Approach 3.3 — Examine procedures for the development of more 
effective performance through teacher training, and for the 
development and improvement of existing teacher supp6rt iystans , 
Inservils^ training of teachers pind staff developii^ent for support 
personnel goes on in most school districts in some form, • ' 
For the most part, this training has not been subjected to 
experimental analysis to determine the differential effective- 
ness of alternative procedures • Effective ways must be de- 
signed to train teachers while they are performing as teachers. 

Similarly, although workshops for teachers provide a common 
mechanism for ijpdating teaching methods in public schools, 
the effectiveness of workshops continues to be questioned. 
Procedures must be developed that permit assessment of the 
impact of workshop strategies on the classroom performance 
of students and teachers. 

A second ar^a of concern within this Approach considers the 
roles of teacher-support personnel (psychologists, social 
workers, counselors, etc.) as they can assist the teacher's 
classroom efforts to deal with social and behavior problem3. 
A number of recent research reports indicate that teacher 
support personnel who are able to assume the role of behavioral 
coifeultants to teachers can effect substantial (low cost) 
improvement in both teacher and student effectiveness; and, 
at the same time., reduce the need for special classes and 
therapies. Although there are some encouraging indicators, ^ 
there is a serious lack of information on how to train 
support personnel, and on the effects of .their training on 
subsequent teacher and student performance. An experimental . 
analysis of various training procedures is an evident need. 

In a comparable fashion the role of the curriculum specialist 
was considered. Although data are lacking, experience suggests 
that in many cases curriculum specialists have little impact 
on improving teacher performance in subject area instruction 
because their activities are largely restricted to program 
selecti'oA, and evaluation. Missing is the training function 
in how to do things better. 
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Still another related concern is to revise administrators*' 
roles so that they, too, more directly support teacher 
performance and satisfaction. Because administration at 
the building level is concentrated in the role of the 
principal, experimental analyses of t,he performance of 
this role are particularly needed. Particular emphases 
need to be given to experimentally specifying the ways the 
principal's attentrm can be used to alter and support teacher 
behavior. 

Finally, there is a need ^ examine more c^efully the 

relations between the processes by which teacher improvement 

programs are established and their effectiveness* Specifically, 

techniques must be devised that will increase teacher 

participation in the design of inservice trainings programs, 

# 

Approach 3, 4^-Develop, through empirical research, systematic pro- 
cedures that can be use e* to define the goals and ob jectives 

of educardonai programs. The eaucatidn^i pro^riirt 6r tftS 

public schools (and other educational agencies) suffers from 
inadequate definition of its goals and objectives. This 
deficiency makes it difficult, if not impossible, to establish 
criteria of program effectiveness and results in a serious ^ 
lack of accountability at all levels in education. Without 
clear objectives it is not possible to conduct a coherent 
program of inservice or preserv:ce training for teachers 
and teacher-support personnel ^ to differentiate effective 
from ineffective procedures , to assess the merits of proposed 
or achieved change , or to support or refute the contentions 
that the schools are irrelevant," of'-^evfen harmful, 

A goal statement describes an intended and desired outcome. 
A definition of the desired outcome also provides the primary ^ 
criteria for determining and describing approximations ,to ^ 
that outcome. Without the referent that such a statement 
provides, any evaluation can be dismissed as irrelevant to 
the "real purpose" of the school or educational program, ' 
On the other hand/ if such a statement is appropriately 
constructed, it ::an serve as a basic reference point against 
which the current status and the progress of a program may 
be judged- Such judgments may be made, however, only if 
the goal is stated in terms that are reliably measurable. 

The requirement^ ^hat educational goals be stated in measurable 
terms does not restrict or in any way prescribe the content 
of the goal. The relative absence of clear statements about 
thQ humanistic and affective objectives of education in the' 
behavior analysis field may be a comment on communications 
barrios within the broad field of education, but it does not 

^ " / 

ERIC ' 



7 



indicate that objective goal statements are incompatible 
with humanistic or affective goals. A goal statement that 
is found to confine the educator too much is a poorly conceived 
statement and should be revised. ^ 

A variety. of attempts to implement and to evaluate educational 
intervention programs during the past decade , including EPDA 
(Educational Personnel Development Act) , ESeA (Elementary 
and Secondary Education Act) , Head Start, Und Follow Through, 
have been either successful or unsuccessful, depending on 
the private or post hoc criteria of various commentators. 
These discrepancies in judgment have served to highlight the 
need to state definitions of goals and objectives before 
the programs are initiated. At the same time, it has become 
evident that relevant goal statements must reflect the greatest 
possible collaboration of all participants in the program — educators, 
parents and children. 

Specific goal setting is a hallmark of behavior analysis. 
The initial featement of a final objective (terminal behavior) 
coupled with continuous measurement provides an ongoing 
description of progress (or the lack of it) toward that objective. 
The procedures for developing useful goal statements are 
relatively standard and well understood by behavior analysts, 
but only for rather small scale activities that involve re- 
latively few participants. The extent to which current 
procedures can be applied to the very large scale require- 
ments of entire educational programs is an experimental 
question of some urgency. 

Specific suggestions in this Approach include: development 

of a conceptual and empirical analysis of the goals and procedures 

pf humanistic education and better translation of these 

into performance, and the development of acceptable measures 

for more abstract goals such as creativity, initiative, goal 

setting, and problem solving.* , > 

Approach 3.5 — Develop a community education training program 

for parents . This„ Approach was not develoned bv the 
Pansi . rc~was a recurrent topic, however, and is included 

h^rja primarily to emphasize the Panel's conviction that 

the education of children is not a school-bound process. A 

variety of parent education prog^^ms that would greatly expand 

the educational experiences of school-age children could 

be fashioned. \ 



* 
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Aggrodr:-. 3 6--Develop and evaluate m easures of j-^p^Ahing 
process and outcoihe > Applied behavior analysis is nbted 
for its emphasis on repeated measures of observable\ 
behavior* Generally, these measures have bean reported 'as 
changes in the frequencies of academic and social behavior. 
A tactical strategy was initially adopted 'in which researchers 
measured observable behavior of teachers and children' because 
it was felt that directly observable events had maximum- 
potential for producing significant behavior change. Between 
1965 and 1970, prototypes of observational systems were 
utilized in public schools by a number of investigators. 
At about the same time, evaluations of behavioral change programs 
wore being made by analyzing achievement and rating data. 

The behaviors deemed appropriate for alteration are currently 
shifting in response to: (a) changing educational climates, 
such as the open classroom and the tutorial college environment, 
and (b) interest in measurement and change of more complex 
forms of behaj^or such as creativity and peer-interaction. 

During the past five years research has begun on measurement 
probleins and the development of new assessment instruments, 
but suc^i research is in its preliminary stages. Further, 
this research has 'only started to make contact with traditional 
measurement methodology relating to statistical analysis,- 
reliability models, attitudin^l scale models and validation 
notions such as construct and* concurrent validity. ' 

Central to all research and service needs in education are ' . 
the measures by which one judges the effectiveness of a 
program. Consequently, there is an imperative need to 
develop systems which measure teacher and student behaviors \ 
in a way that will allow the researcher to systematically 
evaluate behavior and give teachers immediate feedback \ 
regarding themselves and their pupils. \ 

This Approach also emphasizes thfe need for the development 1 
of systems which can measure the extent to which various 
consumers are satisfied with educational/programs. If programs 
are effective in producing academic and social gain, but are 
disliked by parents (e.g., because they feel too much pressure 
is placed on a child), those programs will not endure. The 
explicit recognition of "consumer satisfaction" as a central 
rather than a peripheral concern is a call for the development 
of a badly needed, but still unavailable, measurement 
technology. 

Other needs identified by this Approach include: measures 
of self-control and affect; specialized measures to describe the 
full range of effects achieved by PSI (Personalized System of 
Instruction) courses at the college level; and methodological 
reseach on problems of reliability and validity. 

^0 
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Approach 3.7 — Develop and test methods by which teachers and 
teacher-training ir^titutions can make themselves more accounta- 
ble for their perf dbnance . Two terms used in the statement of 
the Approach should be defined. The meaning of the term Accounta- 
ble is indicated in the following statement: "Accountability is 
a relationship in which the participants agree in advance to 
accept specified rewards and costs on the basi,s^ of an evaluation 
of specified ends." (Alkin, M. , and Baker, E. B., Pp. 245-6 in 
N. L. Gage, Ed., Mandated Evaluation of Educators: A Conference 
on California's .Stull Act . Washington, D.C., Capitol Publications, 
1973. ) Performance may Include what the teacher does and what 

effect it has on students and others. 
«^ 

Recently, throuah the Stull Act and the Rodda Act, the 
S\:ate of California has required that school districts institute 
accountability in regard to the performance of elementary, 
secondary^ and community college teachers and administrators. 
Several other states are considering similar legislation. 
Formal accountability procedures have also been developed 
in applied behavioral programs, where, it appears, they can 
result in increased effectiveness and "consumer" satisfaction. 
This result might be expected, for a wealth of evidence has 
shown the importance of differential feedback on outcomes 
in leading to improved human performance. 

Programs under Approacli 7 will: (a) examine those conditions 
necessary to create a willingness to adopt and the ability 
to carry out accountability procedures; (b) develop clear 
and comprehensible criteria of accountability; (c) define 
optimum consequences for different performances; and (^) study 
the impacts of installation of accountability programs. 

Approach 3>8 — Develop criteria for funding educational research 
which can ensure outcomes of dir>ect relevance to teachers' 
instructional objectives, 'and which are acceptable to the 
communitjy^ institutions involved . This Approach assumes that 
methods of funding are amenable to experimental investigation and 
that certain factors related to funding may be crucial in 
determining the ultimate impact of the research. The Panel knows 
of no research 'that has experimentally evaluated the conditions 
of fundinq. Fundinq generally has been based on exf)ort judqment 
ftnd |n)| i r ic.-t 1 pr ior i t ies . ' 
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In. addition to the ordinary research criteria of potential 
productivity and intrinsic merit, the involvement of the 
community that is the recipient of the research is a factor 
which has been severely neglected. Feedback systems could 
have significant impact on grant recipients regarding 
formulation of problems and methods of implementation and 
evaluation. Such systems have begun to influence behavior 
analysp.s projects, but have not been experimentally analysed. 
Finally, while "consent" is a term currently in vogue, 
research concerning the people involved in the consent and 
dissent process is almost nonexistent. 

Research programs aimed at aiding funding agencies in 
assessing research impact could include the analysis of 
factors such as: 

1, The extent and degree of authority of various "principal 
and participants in the proposal activity, (Who gets 
involved, when, how often, by what processi; with what 
authority, etc, ) . 

2, The methods by which feedback is provided to those 
included in the research (orally, written, practical 
relevance, etc) 

3, The methods by which dissent is handled (assignment 
of limited authority to designated figures in groups; 
third -party arbitration; consensus; veto power; etc). 
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LIST OF APPROACHES AND PROGRAMS 
___ , ^ 1 — , — 

Increase the utilization of applied behavior 
' analysis m the preservice education of 
teachers 

• r » * 

a. ^ Behavior analysis as course content — 

develop ways to teach trainees the 
concepts/ inethods>, ^and procedures of ^ 
behavior -analysis in education 

b. Personal-social skills training — develop 
a personal-social skills training program 
for preservice teachers (trainees) 

c. Behavior analysis as method — devise^ 
systems which use behavior analysis 
methods in the teaching of trainees 

Develop procedures for installing and main- 
taming effective teaching and teacher • 
education techniques and systems m new - 
settings 

% Dissemination specification — develop 
procedural specifications for program 
design and evaluation that will improve 
disseminability 

b. Dissemination techniques — develop pro- 
cedures to disseminate new programs 
that will improve their implementation 
and maintenance ^ 

Examine procedures for the development of more 
effective teacher perfomance through teacher 
training^ and -the development and improvement 
of existing . teacher support systems * ^ 

a. Inservice prooedufes — produce training 
procedures for generating and maintaining 
improved teacher perfomance 

b. Training of support personnel — expand the 
roles of teacher-support personnel 
(psychologists / social workers, 'counselors, 
etc.) in helping teachers to deal 

with social and 'behavior problems directly 
in the classroom. \ 

c. curriculum specialists — expand the role of 
curricul(iin specialists and supervisors ^ 

52 
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d. Administrative support - revise 

.^4ininistrators* roles and structures so 

£hat they provide more direct support 

for teacher performance and satisfaction 3.3.4 

e'. Increasing teacher parti'cipation- 

increase teacher participation in the 

design of inservice training programs 3.3.5 

f . Teaching self-control — develop a 

behavioral self-control skills training 
program for teachers and students 3.3.6 

^ • Develop^ through empirical research, systema- 
tic procedures that can be used to define the 
goals and objectives of educational programs 3,4 

a. Identifying participants — develop 
procedures to identify those' who 
consider themselves par1;icipants in 
various types of educational 

programs 3.4.1 

b. Goal SelectiOQ by participants - 
develop procedures that-^>ermit partici- 
pants to select general and individual 

goals - 3.4.2 

c. Setting humanistic goals - - develop 

a conceptual an* empirical analysis of 
the goals and procedures of humanistic 
ecJucation 3.4.3 

d. Goal measurement - devise methods for 
creating acceptable and reliable measures 

of attainment of participant-selected 3.4.4 
goals 

e^ Tests of planned variations — implement 
model programs in various types of 
educational programs 3.4.5 
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.5. Develop a community, education training 

program for parents 3.5 

6. Develop and evaluate measures of teaching 
processes and outcomes 3 . 6 

a. Measures of student and teacher* 
behavior — develop systems which 
measure student and teacher behavior 

in a variety of educational settings 3.6.1 

b. Cons.umer ' satisfaction measures — 
develop systems for measuring consumer 
satisfaction with educational programs 3.6.2 

c. Measures of self-control and affect — 
develop measures of self-control and . 
affective and emotional responding 3.6.3 

. / • 
d/ Post-Elementary school measures of 

effect — develop new measures of the 
effectiveness of high school and college 
education 3.6.4 

e/ Problems of. reliability and validity 
— methodological research on problem^ 
~- of reliability and validity • 3.6.5 

f . Analyses for within-group desigiib — 

develop data analysis methods and research 

designs for single-subject (single 

group) research 3.6.6 

7 . Develop and test methods by which teachers 
and teacher-training institutions can make 
themselves more accountable for their 
performance " 3.7 

a. Preconditions for. accountability — 
identify and develop^ ways to create 
preconditions for accountability 3.7.1 

b. Accountability criteria — develop 
procedures to establish accountability 
criteria appropriate to various 

settings and conditions 3.7.2 
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c. The use of consequences — develop 
procedures to proy4-de different 
consequences for different 
performances 

d* The effects of accountability — ^ 

assess, the effects of, accountability ' 
procedures on var1.pus members of 
the schodl and coimripnity 

Develop criteria for funding educational 
research which can ensure outcomes of 
direct relevance to teachers* instructional 
objectives, and wnich are acceptable t o -tHe 
community institutions involvid 

a. Effects of various funding procedures — 
measure selecfed process variables as 
a function of the method of funding NIE 
proposals 
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GOAL STATEMENT 
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The goal of • this . Panel is to develop the means to 
improrve teachers* ability to perform general and 
specific skills of teaching within curriculum areas 
and student development levels. 
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SUMMARY 



The Panel on Teaching as Skill Performance focused on research to 
improve teacher performance cf instructional skills. This research will 
be based on two approaches : 

1. The identification oJ important teaching skills by: (a) utilizing 
theoretical statements drawn from psychological, developmental, and 
pedagogical theories, as well as theories of subject matter; (b) analyzing 
observed teacher practice into skill components and showing empirically 
the relation of these components to educational outcomes; and (c) 
utilizing reports of teachers and other person^ concerning what they believe 
to be important teaching skills. 

2. The identification of training and validation procedures which 
demonstrate how the teaching skills are related to educational outcomes. 
This approach looks at: (a) the transferability of the skills, (b) the 
school conditions needed to optimize maintanence of important skills, 
(c) the development of measures to define the effectiveness of teaching 
skills, and (d) the relationship of the repertoire or set of skills possessed 
by individual teachers to. educational outcomes. 



DISCUSSION 

Pp^finitions of Teaching Skills ' ' 

The Panel began its deliberations with an attempt to develop a 
definition of teaching skill. Although several issues were presented and 
discussed, no formal definition was made by the Panel. The following 
aspects of teaching skills wete accepted, however, a^ a working characteri- 
zation of the term 'skill'. \ 

\ 

Teaching skills exist in a variety of teacher roles, 
e.g., in relationships with school principals, or 
parents, as well as with students. \ 

Teaching skills have consequence? . A logical\ chain 
connects' a specific skill with its consequences, 
llie ' consequences can be both direct and indir^^ct. 

Operationally, teaching skills are .time-bound in the 
sense that t;he outcomes or consequences of a skall 
must bje obsei;vable within a reasonable period, 6.g., 
a school year. ^ 

Specif ic , teaching skills may be distinguished from 
skillfulness . The latter includes: (a) determining 
is to be done, (b) asking whether a particular 
skill achieves the desired effect, and (c) timing the 
' use of a specific skill to^ achieve the effect. 
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Specific teaching skills can be rated for quality* 

Normative criteria have been established' for the . 
performance of certain t^^ching methods vhich 
• incorporate specific skills. 

Teaching skills are moderated by the context or 
situation in which they are performed •( 

A skill has an intentional or purposeful aspect; 
i.e., there is a reason for performing a particular 
skill. ^ ' ' 

Skills of special interest to the Panel are those 
which are trainable, but a second group of un- 
trainable or diff icult-to-train skills (or "aptitudes") 
is recognized. 

Assumptions about Research in Teaching as Skill Performance 

Several assumptions guided the Panel's development of approaches, progr'ams 
and projects. They all specify research that has: 

1. Practical value. 
• 2, Acceptance by its potential users and the research community. 
3* Potential for yielding scientific knowledge. ' . ^ 

A. A balance between the interests of the non-research public 
and the research bommunit^. 

5. The involvement of teachers as well as researchers in determining 
the skills and educational outcomes to be studied. 

6. A decision-making model that optimizes support, use, and 
scientific payoff across a program of research. The Panel 
developed a matrix structure for such a decision-making model. 
See Exhibit .1. * . * 

Tliis matrix has four dimensions. Each of these dimensions repres.ents a 
continuum which, for purposes of display, is shown as a dichotomy in the 
exhibit. Dimension 1 deals with the degree to which the antecedents to 
the research represent public school inputs and acceptability as opposed 
to Researcher or scientific inputs. Dimension 2 represents the ease or 
difficulty of measuring the dependent and independent variables. This 
dimension is related to Dimension 1 in that the value assigned to 
particular variables by public school persons. or researchers iSay be 
moderated by how easy or difficult these variables are to measure. 
Dimension 3 represents a central feature of the research design of the 
project. At one extreme (univariate) only one teacher training^.|irx)cedure 
or one teacher skill and/or one pupil outcome variable would be^ involved- 
At the other extreme mult ip,le skills and multiple pupil outcom^^ A/ould 
characterize the design. This dimens-ion is also related to Dimensions 1,^, 
and 2, e.g., a researcher may be attracted to designs with easy-to-measure 
variables of his own choosing since he can optimize control of experimental 
error in such designs. But such studies^might be seen as having less ^ 
practical value in the eyes of public school persons. Dimension 4 (represented 
within each of the cells of the matrix) addresses the question of research 
pay off. In this dimension, the decision maker must assign probabilities to 
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both the potential acceptance 'and use of the project outcomes and to their 
potentl^al for contributing to scientific knowledge. 

This matrix can be used to analyze a proposal by identifying in which 
box at each step of development the proposal falls* The structure provides 
' .a schema for seeking information about the involvement of different 
comArunities of concern and interest. It also provides a scheoia for 
checking the stage of development of the antecedent variables and their 
sources and of tlie development of th3 outcome measures. 

What'Ihis Structure Omits . This structure omits the weight's to be assigned 
to the elements of the structur3 and the decision rules. 

It also omits the specific variables that might or should appear in the 
research program. It does not resolve methodological or theoretical 
issues. It simply points to choices to be made and raises the question of 
what criteria ought to be applifed in making these choices. The Panel used 
the matrix to bring out choices, problems, and issues in conceptualizing 
a research program. 



Approach 4*1 : Examine Alternative Approaches to the Definition and Identification 
of General and Special Teaching Skills 

Research efforts under this Approach are built around three programs. 
In Program 4.1.1, the goal is to develop and apply a conceptual*- analytic 
method for Identifying hypotheses about effective teaching skills. In 
striving to achieve the goals of this first program, planners will need to 
utilize conceptions of instructional roles generated from the following 
sources: (a) the explication of theory relevant to education; (b) designs 
for schooling— the demands of existing school organization patterns and 
alternatives; (c) Curriculum approaches; and (d) the intersection of two 
or more of thes^ sources. 

Five Projects were developed by the Panel to illustrate the work of 
Program 4.1.1. In the first project (4.1.1.1), the goal is to generate 
hypotheses about the influence^of pupil characteristics on the effectiveness 
of teaching skills derivtid from a theory of inductive teaching. While there 
has been much ATI research and development of theoretical models relating 
educational procedures to pupil class, few investigations have explored the 
effectiveness of specific teaching skills, such as those required in 
inductive teaching, i^i termsVof pupil characteristics. The second project 
(4,1«1.2) in this series aimsN^ the generation of hypotheses about 
effective teaching sjcills throug^v^erationalization of John Dewey's 
social theory. Most attempts to app^lv democratic process theory tp educatix)n 
have^ryn into severe difficulty because essential and valid teaching skills 
have not been created. Hence, systematic teacher training was not developed. 
In the third project (4,1.1,3) the goal is to generate hypotheses about 
teaching skills from the Study of teacher adaptation to the instructor's 
role in systems oriented 'instruction in reading (e.g., IPI, IGE), Systems 
approaches to early^eading cannot be carried out without teacher acquisition 
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of relevant skills. The ability of teachers to transfer skills from one 
role ta another — as well as their ability to acquire new skills — is 
virtually unknown. The fourth project (4,1. 1,4) in the series focuses 
iux the development of concepts related to subject matter competence with 
respect to teachings Tliere is a need to reexamine subject matter 
competence so as to generate content learning strategies in the preparation 
i)f teachers. In many content arenas j knowledge is substituted for 
procedures* The final project (4.1.1.5) the specific objective is to q 
identify and operationally define teaching skills which are logically 
necessary to the achievement of moral development outcome^ as defined by: 
(a) theoretical foundations relevant to education, (b) curricular frame- 
works, (c) school organization, and (d) the intersection of two or more 
of these elements. 

The second Program (4.1.2) in Approach 4,1 proposes to examine 
differences in achievement levels of students, and to identify teachers* 
acts or strategies that affect those differences. In developing the Program, 
the Panel suggested three concerns: (a) skill identification, (b) 
characteristics of the studies to be funded, and (c) criteria for evaluating 
descriptive, observer-based studies designed to identify teaching skills. 

^ -> . 

lliree Projects serve to illustrate^this program (4.1*2). In the 
fLri>t project (4.1.2.1) the goal is to obtain information concerning teacher 
behaviors and skills in high and low achieving schools. The second project 
(4.1.2.2) aims to delineate those frame factors that most exert influence 
on the effectiveness of teaching performance. In the third project (4.1.2.3) 
the Panel suggests an examination and improvement in the curriculum 
modification skills of teachers. The specific objective of this project is 
to determine decision points, acts, ^nd strategies by which teachers can 
adapt curricula to meet local needs. 

The third Program (4.1.3) in Approach 1 seeks to examine the needs 
assessment and other kinds of expert opinion as a means of identifying teaching 
skills. 

Two illustrative projects were developed as examples of the work to be 
done. Because the projects are similar, they are combined for purposes 
of this report. In the first project_(4. 1. 3. 1) studies would seek to 
identify teaching skills most appropriate to learning outcomes in new 
curricular areas. In the second project (4.1,3.2) the goal is tc determine 
ihv r; I j',nif icancc of student learning outcomes and correlated teaching 
j^kills as viewed by juries of teachers and parents according to school 
setting?;. Practitioners and clients (parents and students) should be 
involved in helping to identify the skills that teachers need for teaching 
students. There exists no reference document cataloguing teaching skills; 
the learner outcomes and- teacher skills must be identified and defined by 
teachers and parents in terms of language and concepts which both groups 
can understand. 
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Approach 4^2 : Examine Alternative Approaches to the Training and Validation 
of General and Specific Teaching Skills 

This second Approach moves from identifying teaching skills to the use apd 
testing of those skills in teacher training. Six programs are offered to 
specify the scope o£ work involved. In the first Program (4.2.1) the 
objective is to examine changes "in the effectiveness of skills caused by 
differences in pupil characteristics, including the detAraination of the 
smallest effectivej stimulus for eliciting a pupil response and the 
appropriate metrics.,^r measuring skills* One project was developed as a 
sample of the work to be done. In Project 4,2.1.1 the Panel proposed to 
study the association between variations in skill magnitudes^ (variations 
in hypothesized effective stimuli), and learner outcomes in reading at three 
grade levels. The specific objective of this project is to determine 
whether variation in skill magnitudes are correlates of on-task behavior 
and residual gain in reading. 

In the second Program (4.2.2) the goal is to analyze training strategies 
to determine which effectively produce acquisition of a skill at each and 
all levels of skill acquisition, using variation in training as the 
inde-penr'ent variable and level of skill acquisition as the dependent variable. 
Four levels of skill acquisition are to be studied: (a) the cognitive level, 
(b) the unit acquisition level, (c) the unit fixation level, and (d) the 
autonomous level. One project was developed as a sample of 
the work to be done. In project 4.2,2,1 the specific objective is to 
determine which training procedures are most effective in bringing trainees 
MP to, different levels of acquisition of different types of teaching skills, 
'flic second Program (4.2,3) in this series seeks to determine the conditions 
(c.g,, s* jdent characteristics and socio-political contexts) which maintain 
Leaching skills. Little is to be gained from training pre-service or 
in-service teachers on specific teaching skills if these skills atrophy, or 
become distorted during extended classroom experience. Thus, investigation 
of the conditions that foster skill maintenance and improvement in actual" 
teaching practice is needed to achieve the Panel's goal. T^^o projects were 
developed as sample work units. In Project 4,2,3.1 the goal is to examine 
the influence of contextual factors on the maintenance of skills in the 
teaching or reading and mathematics: What factors in the social organization 
of the school (e.g., the amount and quality of administrative supervision, 
effective working relations among teachers, etc,) influence the development 
and maintenance of specific teaching skills? Can in-service training geared 
to skill maint*enance reduce or prevent decline in skill perf omiance? 

In the- second project (4,2,3,2) the goal is"^o review and synthesize ^ 
the literature on student influence on teacher behaviors and skills. This 
project should yield a system for classifying the types of student behaviors 
which influence teachers and the type of teacher behaviors which are 
influenced. In addition, the project should yield suggestions as to the 
independent variables that have the greatest impact. The specific objective 
would be to synthesize the literature ^nd produce a quasi- taxonomy of 
student, influence (independent) variables. 
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The goal of the fourth Program (4.2.4) is to determine the transfer- 
ability of teaching skills, i.e., the level at which a skill is performed 
in one context when it has been trained in a different context. The 
purpose of this program is to examine what happens to teacher activities 
in relation to pupil outcomes 'when the context changes, A simple example 
is the question of what happens to the activities of a teacher who has 
learned to teach children reading in a ^'traditional" setting but is placed in 
an "Open" classroom? What skills are transferable into the new situation 
in order to effect learning? Two projects were developed as a work 
sample. In the first project (4,2,4,1) the specific objective would be 
to determine what adaptations of successful teaching have to be made 
when assumptions about the curriculum are changed. In Project 4.2,4.2 the 
aim is to develop the means to improve the transfer of hypothesized 
generic skills within an instructional approach (model) across subject 
matter areas. The specific objective for this project is to test the 
transferability of the teacher's pupil-assessment skills, goals-setting 
skills, instructional-strateg^^r skills, and achievement-evaluation skills 
across subject areas. 

Program 4.2.5 seeks to examine the validity of teaching skills-as- 
^^A^^^'- While this program was not developed in any detail, the Panel 
did recognize major methodological problems in validating skills-as-^rained, 
in finding alternative training proc^ures to circumvent these problems, 
and in attempting to increase the effects of (variance attributed to) 
teacher skills. One sample illustrates the types of projects to be 
included in Program 4.2.5. In project 4.2.5.1 the specific objective is 
to determine whether immediate feedback from students on some aspect of 
the teacher's performance will lead to changes in teacher behavior and 
related learner outcomes. 

The final Program (4,2.6) in the second Approach seeks to examine the 
teacher's repertoire of skills, including itsscope, organization, effect 
on stud^ent outcomes, and relation to teacher characteristics. 

Two projects were developed to explore some of these dimensions. In 
project 4.2.6.1 the specific objective is to determine the effects upon 
learning outcomes of teacher use of higher cognitive questions both with 
and without the support of follow-up teaching skills, e.g., prompting, 
probing and redirection. In project 4.2.6.2 the goal is to examine the 
effect of teaching skill repertoire, organization and sequence on outcomes 
in pupil achievement and attitudes. Most studies that have examined 
effects of teaching skills on pupil outcomes look at very small, discrete 
units or sets of skills. Most of these studies have failed to demonstrate 
empirically that the skills^ in question have an appreciable effect on 
students. The small units and restricted nature of the skills examined 
may have caused the lack of effects. Thus, there is a need for studies 
that examine the potential effects of broad sets of skills that are linked 
together into a conceptual whole. 
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List of Panel Four Approaches, Programs ajid Projects 



Approach 4>1: 



Examine alternative appjroaches to the definition 
and identification of general and special 
teaching skills , V 



Program 4.1 ,1 




Develop and apply a conceptuair-analytic 
method f or^identif ying hypotheses about 
effective skills. 



Project 4.1.1.1: 



Project 4.1.1.2: 



Project 4.1.1.3: 



Project 4.1.1.4: 



Project 4.1. 1.5: 



Examine the Inflmence of Pupil 
Characteristics ori the Effectiveness 
of Teaching Skills Derived from a 
Theory of Inductive Teaching. 

Generate Hypotheses About Effective 
Teaching Skills through Operational- 
zation of John Dewey ^s Social Theory, 

i 

Generate Hypotheses about Teaching 
Skills from the Study of Teacher 
Adaptation to the Instructor's 
Role in Systems Oriented In^ruction. 
in Reading (e.g. IPI. IGE) 

Develop the Concepts Related to 
Subject Matter Competence with 
Respect to Teaching. 

Identify Teaching Skil]^ that are 
Logically Related to Advancing 
Learner's Level of Moral Develop- 
ment. 



Program 4.1.. 2: Examine differences in achievemeitt 

levels of students and identify 
teachers' acts or strategics that 
affect those differences. 



Project 4,1.2.1: Use Inductive Methods to Determine 

Teaching Skills from Observational 
Surveys of Teachers in High-and-Low- 
'Achieving^ Schools . 

Project 4.1.2.2: Determine Relationships Between Frame 

j^'actors and the Effectiveness of 
Teaching. Skillsr 
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Project 4.1.2.3: Examine and Improve the Curriculum 

Modification Skills of Teachers. 

Program 4.1.3: Examine needs assessment and other expert 

opinion as a means of identifying skills • 

Project '4.1.3.1: Identify Teaching Skills Most 

Appropriate to Learning outcomes 
in New Curricular Areas. 

Project 4.1.3.2: Determine Significance of Student 

Learning Outcomes and Correlated 
Teaching Skills as Viewed by Juries 
of Teachers and Parents According 
to School Settings. 

Approach 4.2; Examine alternative approaches to the training 
and vali dation of general and specif ic teaching 
-SlsiUfi.. ' ^ 

Program 4.2..1: Examine changes in the effectiveness of skills 

cauised by differences in pupil characteristics^ 
including the determination of the smallest 
effective stimuluis for eliciting a pupil 
response and the appropriate metrics' for 
measuring skills. y 

Project 4.2.1.1: Study the Association Between Variations 

in Skill Magnitudes (Variations in 
Hypothesized Effective Stimuli) and 
Learner Outcomes in Reading at Three 
Grade Levels. 

Program 4.2.2: Determine which training strategies 

effectively produce acguisiton of a skill 
at each of its levels, using variation in 
training as the ind^ependent variable and 
level of skill acquisiton as the dependent 
variable. 

Project 4.2.2.1: Determine the Effectiveness of 

Different Training Procedures for 
Developing Different Mastery levels 
in the Training of Various Types of 
Skills. 
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Program 4.2.3; 



Determine the conditions (e .g student 
characteristics and socio-political contexts) 
which ijaintain teaching skills. 



Project 4,2.3.1: 



Project 4.2.3.2: 



Examine the Influence of Contextual 

Factors on the Maintenance^ of Skills 

in the Teaching of Reading and Mathematics, 

Review and Synthesize the Literature 
on Student Influence on Teacher Behaviors 
and Skills^ 



Program 4.2.4 



Determine the tran^erability of skills, 

i.e., the level at yLrhich a skill is 

performed in one cafntext when it has been 
trained in a different context. 



Project 4:2.4.1: 



Project 4,2.442: 



Program 4.2.5: 



Examine the Changes Teachers Make 
When Operation Under Different 
Curricul?ir Assiamptions . 

Develop the Means to Improve Transfer 
of Hypothesized Generic- Skills Within 
an Instructional Approach (Mode) Acroes 
Subject M^ttter Areas. 



Examine the validity of teaching skills-as- 
trained. 



Project 4.2.5.1: 




Examine l?^tini^&us Feedback from 
Students on a Single Teacher .Behavior 
Variable. as a Means of Changing 
Instructor Behavior and Student Outcomes, 



Program 4.2.6: 



Examine the teacher's repertoire of skills, 
including its scope, organization, effects 
on student outcomes, and relations to teacher 
characteristics . 



Project 4. 2. '6.1; 



Project 4.2.6,2; 



Determine the Effects onjiearn^tng 
Outcomes of a Teaching /^trW teg y 
Combining Higher-Cognitdve-^evel 
Questioning, Prompting, Proping and 
Redirection . ^ 

Examine the Effect of Teaching Skill 
Repertoire Organization and Sequence 
on Outcomes in Pupil Achievement 
and Attitudes. 
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SUMMARY ■ • . 

The Panel on Teaching, as a Linguistic Process in a Cultural Setting organized 
its research approaches and programs under three questions:^ 

1, In what ways is effective communication in the classroom different 
from ordinary, everyday talk to which all children ate enculturated?, 

2, What particular ' communication problems are encountered when the 
participant's come from different cultural backgrounds? 

3, How can the teacher's work be. improved on the' b^sis of the understandings . 
achicfv.ed in the above research? 

• DISCUSSION . t - , " . 

The study of linguistic phenomena in school settings should seek to answer 
edXicational questions. This Panel is therefore interested in linguistic 
forms only insofar as through them we -can gain insight into the spcial 
events of the classroom and thereby into the understandings which students 
achieve. Our specific interest is in the' social contexts of cognition: 
speech unites the cognitive and the social. The actual (as opposed to the 
intended) curriculifin consists of the meanings enacted or realized by a 
particulat teacher and class. In order to learn, students must use what 
they already know so as to give meaning to what the teacher presents to. them. 
Speech makes available to reflection the processes by which students relate 
new knowledge to old. But this possibility depends on the social relationships 
and the communication system which the teacher establishes. 

The basic assumption that underlies all of this Panel's approaches is that 
language (verbal and non-verbal) is more thati a me4ium for referential 
communications. In contrast to computer languages, fOr exan^rle, the form 
and structure of what is said in natural languages and the speaker's 
selection among verbal and non-verbal alt'ernatives significantly influence 
the interpretation of meassages and thus the results oJE education. This 
assumption is basic ,to modern linguistics, cognitive psychology, cognitive 
anthropology, and ethnography which are the core disciplines relevant to the 
work of this Panel. o 

Wg have considered the special domain of our Panel to include three questions. 
The first question asks, " In what ways is effective communication in the 
classroom different from ordinary , everyday talk to which all children are 
encluturated? " , Approaches 1 and 2 address this question. 

Approach 1 calls for , continued basic research on ways of describing 
classroom talk. Mindful of the many analytic schemes now in existence, 
we are not recommending further proliferation of ^d hoc ^ non- theoretical 
work. But we are convinced that recent theoretical insights in the core 
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disciplines offer new and promising approaches. 



Approach 2 call's for research in a virtually untouched area; hpw 
children learn to talk appropriately in school. It is only when a * 
"stumble" occurs in the normal flow of talk that one is aware that 
rules do exist for the classroom discourse "game," and that children 
have to learn them. For example, the following occurred in a middle- 
class preschool: 

(referring to yesterday's cooking 
experience) What did we put in the 
sou^ 

(gives a questioning look)^? 

repeats question with smile. 

Dunno , What ? (continuing conversation 
with a smile as if tb scy$ "OK, let's 
play together.") 

(Giggling and looking embarassed). No , 
you tell me (Elsa Bartlett, personal - ^ 
communication)^ ' / 

While it is appropriate for a child to say he doesn't know the answer txx 

a teacher's question? it is not appropriate in school, as it might be at \ 
home, for the child to ask the adult to provide the answer. More general ^ 
documentation of the need for continued rule learning comes from situations / 
of discontinuity within the school experiences itselfi— ie.g», when first^^ ^/ 
grade teachers complain that children who have been in Headstart don't kn<5w 
how to behave in school (verbally as well as nonverbally) ; or when older 
grade teachers complain that children haven't learned how to work in 
committees. » 

The second question (especially significant for NIE's goal of supporting 
maximal educational opportunities for all) asks, . "Wha t particular 
communication problems are encountered when the participants come from 
different cultural backgrounds?" Program 5.12 and Approaches 3, 4, 5 
are ^addressed to various aspects of this question. 

Program 5.12 calls for research on the "frame factors" (i.^., the variables ^ 
that constitute the context within which classroom discourse occurs) 
which influence classroom discourse. Since student and teacher characteristics 
are included anSj^g/ these frame factors, this approach subsumes such phenomena 
as the interaction between the structure and size of the classroom group 
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and th€L. cultural' backgrounds of students. For example, Bellack, _et £l . (1966) 
reported a high consistency of certain features of classroom discourse 
across classrooms, including a very high proportion of ''soliciting" 
moves made by the teacher. In different research traditions^ this 
teacher-#soliciting-pupil responding pattern has been shown to be ineffective 
and even detrimental to the participation of Black children, Hawaiian children, 
and American Indian children. To design more powerful educational environ** 
ments, we need more information about^iow different children respond in a 
wide variety of situations. 

Approach 3 includes three more specific aspects of cultural differences in 
language use: comparisons of language use in school and at home; the pheno- 
menon of language mixing as it accurs in iDilingual and Jbidialectal classrooms; 
and a suggestion for the development of one curriculum area, science, for 
expanding children's di;Bcourse repertoire. While any lesson can be used for 
this purpose if the children retain a dual focus on subject content and 
discourse process. Science seems to be an especially useful context because of 
its particular coTwnunicative demands and the relative value neutrality of 
its content. , 

Approach 4 examines differences in the quantityand quality of encounters 
between teachers and children in which knowledge and skill is or is not 
transmitted*. The hypothesis behind such research is that the distribution 
is usually unequal, that such inequality is based on the cultural identities 
and values of the participants, and that qualitative differences in the 
verbal and nonverbal aspects of the encounters (the covert message) are as 
important an influence on learning as the frequency of the encounters them- 
selves. F5r example, a teacher or guidance counselor can tell a pupil about 
what it takes to be a doctor, and yet convey, in subtle aspects of the 
adtjlt's verbal and nonverbal behavior, that that role is not for the pupil. 

Approach ^ deals Specifically with interaction in bilingual classrooms. 
Problems in learning, and therefore in teaching, encountered by children who 
do not understand English, are being discussed at all levels of educational 
decision-making, up to the Supreme Court (e.g., Lau vs. Nichols). Both 
Court decisions and legislation in many States have mandated improved teaching 
techniques for children of limited English-speaking ability. 

Moreover, recent research findings indicate that a second language, like a 
first language, may be learned better from being used in specific types of 
natural communication situations* Knowledge about the specific characteristics 
of classroom discourse conducive to second language learning is important for 
the general school curriculum as well as for*special language classes. Approach 
5 seeks to determine those aspects of classroom discourse that can contribute 
*most to second language' learning and have least effect on first language loss. 

We do not in any way imply that the problems of non-English speaking children 



deserve more research attention than the problems of children who speak a 
non-standard form of English. BidialectaL and bilingual settings share 
an important characteristic: the participants* attitudes toward language 
differences are at least as in^ortant as the extent of the linguistic 
differences themselves^ B9th are h£gh priority setti-ngs for all our 
proposed research. 

Aspects of the question addressed in Program 5.12- ^nd approaches 5.3, 5.4 
and^ 5.5 are sfip'arated here for presentation purposes only. Any one research 
project might involve variables that are sepairated here. 

The third question asks, "How can thg teacher* s work be improved on the basis 
of the understandings achieved in the above research?" Because we believe that 
the most potent effect comes through a teacher's analysis of her own behavior 
rather. than by the presentation of substantive findings in any pre-or in-service 
course, there is a particularly important relationship between all of the 
above research and our suggestions for teacher training. In short, we want 
to teach teachers to be their own informal ethnographers. Thus, effective 
methodologies for analyzing any aspect of classroom discourse will not only 
yield subBtantive information, but also constitute procedures that may be 
adaptable for teacher training in self-analysis. 

Recommendations for research on how to help teachers interact more effectively 
could have been appended to eqjh of the proceeding approaches. They are 
separated here partly for simplicity of presentation and, more importantly, 
because any one project to cTiange classroom interaction patterns may draw on 
findings' and methodologies from several approaches, not just one alone. 
Take, for example, the findings of the U.S. Commission on Civil Rights (1^73) 
Mexican-American study that teachers in bicultural southwestern classrooms 
respond more often to Anglo children than to Mexican-American children with . 
acceptance and praise. It ^seems unlikely that these interaction patterns 
can be changed simply by ^fetting the teach'ers to distribute their praise 
hiore equally. We assume that teacher-student interaction is a two-way 
interactive system, and that the teacher needs help in understanding not 
only what she is doing (Approach 5.lVi5ut also what the children are doing 
■nd why (Programs 5.3.1 and 5.3.2) a^id how children can be help'ed to acquire 
new communication strategies (Appro>(ch 5.2) . 

In making these recommendations, \Ja recognize that, in the end, it is necessary 
tO" show ^e effects of these linguretic, or discourse, processes on what 
children learn about substantive knowledge and skills, about themselves and 
their society, about their conceptiorite of self as learner. We also recognize 
that we are asking NIE to invest further in a field where few analyses 
have so far been able to show such effects. Our hopes for increased under- 
standing, and thereby improvement of the teaching ^process, rest on three 
arguments. First, that more powerfu.l analys^es of linguistic phenomena are 
beings and can further be, developed; second, that wherever possible, studies 
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on classroom discourse' must di^erentiate more than they have in the past 
among the conmunicative roles tn^ children play as subgroups and individuals, 
rather than consider them es a tot^l classroom group; and third, that research 
should compare classroom interactions selected on some criterion of effective- 
ness. Each of these arguments deservH^ further comnent, . ' 

In any research dealing with coraraunicatidn, the data and methodology are 
inseparably connected with the res.earch totolc and research goal. Given the 
present state of socio-and psycho-linguistlfc- theory, it is Inyossible and 
premature to agree on a definitive set of vaVLd and analyzable variables. 
Possible linguistic variables include th# following (in an unordered list): 

1, Content categories (words or phrases) occurring in texts 
and measured in terms of frequency, co-occurr6(ice, or type-token 
ratio, « 

2, Discourse structure, sequence, and strategies\eem as moves 
in a Wittgensteinian language game, 

3, ' Rules governing the selection of phonological, syntactic, or 
semantic variables, 

4, Lexical structure as studied by cognitive anthropologists 
and psychologists. 



5, Non-verbal channels and signs used in interaction. 

Which variable is selected depends on the question being asked, While\iany of our 
approaches and programs deal with discourse structures. Approach 1,2 \ 
might involve content categories and lexical structures when frame factors^ 
of subject matter and forms of knowledge are involved; Approach 5,2 on code\ 
switching involves the rules governing the selection of phonological, 
syntactic, or semantic variables; and Approach 5.4 on the distribution in 
quantity and equality of educational encounters would also require the analysis 
of nonverval channels and signs. It is obvious that the expertise required 
f the investigator, and the equipment and time needed, will vary in each 
ase. Wherever possible, practicing teachers should be collaborators in the 
^research, because it is their judgments as participants that we seek to 
understand. 
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Mexican-American Study); some perceived evidence of ability; sex or some 
combination of these and other characteristics. Such patterns can be dis- 
covered only if information on the identity of individual participants is 
maintained. Once they are discovered, further research is possible to 
explain why they occur and how they might be changed. 

How do we arrive at some criterion of effective discourse? Ultimately, we 
want to tLelate. aspects of linguistic processes in the classroom to children's 
learning (see Piestrup, 1973, for an almost unique example of relationships 
bewteen (a) features of teacher-child interaction in the teaching of reading 
and (b) reading achievement). A helpful analogy may be provided by research on 
the effects of drugs; doctors need to know main effects and dide effects* 
intended and unintended outcomes, on patients with particular characteristics. 
Similarly, information is needed on the effects of particular interaction j 
patterns. Such information is essential for informed decisions by teachers \ 
themselves and by others who are involved in the selection and pre-and in-servid 
training of teachers, . But we realize that at this point we share with all 
evaluation research the wei^kness of available outcome measures, especially 
measures of more subtle and more long-terra effects* 

Two alternative strategies are possible. One is to build into any classroom 
interaction research a comparison between classrooms which have been independent- 
ly judged to be more or less effective on some eriteriar even if actual learning 
outcome^ measures are not available. The judgments' of teachers and even childr 
can be used. Rosen and Rosen (1972) quoted extensively from classroom discourse 
selected as exemplary by sensitive teachers. Lein observed a teacher considered 
••their favorite** by Black migrant children in Florida. She eomments: 



It would be important to analyze the interaction of such teachers in more 
detail. 

Alternatively, one can decide to work with process rather than product indices 
of the quality of classroom language. Such process measures might include 
some internal criterion of ••coherence^" measures of increased communication 
(either in more equal distribution of talk, or decreased misinterpretations of 
the talk that does occur), or qualitative evaluations of the cognitive level of 
children's contribution to the discourse. 



•• Sitting in his class, I realized how 
difficult it would have been for me to 
cope with his teaching style had I been 
in his fifth grade. His speech was full 
of threats, and his manner seemed challeng- 
ing and intimidating to me. However, the 
migrant children spoke to him spontaneously 
participated actively in his class. •• 
(1973, pp. l43-.4>. 
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LIST OF APPROACHES AND PROGRAMS 

I, In what ways is effective communication in the classroom different 
from ordinary talk t,o >yhich all children are enculturated? 

1. Determine the Rules Governing Discourse and the Relationships 
between Classroom Discourse and Frame Factor^, in the Institutiojial 
Setting of the School. 5.1 

a) Investigate the nature of rules governing classroom 
discourse by developing and adapting measurement instru- 
ments 5. 1.1 

b; Determine ways in which classroom language varies as 
a function of frame factors, and their interaction 
the institutional setting of the school [assuming that- 
"classroom discourse is patterned , and not randomly or- 
ganized] , 5.1.2 

\ 2. Study the Acquisition By Students of Rules for School 

Discourse. 5.2 

« 

a) Determine which aspects of t,he classroom serve to 
facilitate or hinder the learning of appropriate discourse 
and interaction rules [ e.g., teacher - child ration; 
curriculum content, etc.]. 

b) Determine which aspects of the classroom serve to 
facilitate or -hinder the. learning of appropriate discourse 
and interaction rules by students who are members of a 
specific socio-ethnic group. 

XX ^ What particular communication problems are encountered when the par-" 
ticipants copie fro p different cultural backgrounds? 

3. Determine the Ways in Which Difference* ii Dialect, Language'- 
-Style, and Interactional Norms Affect Learning in the Classroonw 
(These differences may be between teachers and pupils and/or 
^ , among pupils .) . . " 5.3 

a) Compare children's interaction patterns in multiple 
settings, out of school as well as in school, 5.3.1 

b) Determine how two languages or dialects are combined 
in a classroom and how language and dialect differences 
are exploited for comminicative ends through code and style 
switching. 5,3.2 




c) Explore science as a curricultmi context for teaching 
children to use more context- independent speech, 5,3,3 

4, Describe and Analyze Patterns of Student-Teacher Communication in 
order to Determine the Effect of the Social Identity of the Participants 
on the Way in Which Teachers Overtly and Covertly Present Information, 
Additionally, Analyze the Effect of Such Differential Presentations on 
the Acquisition of Knowledge and Skills,^ 5,4 

5. Specify the "Critical Components or Characteristics of Natural 
Communication Situations that are Necessary for the Acquisition of 
Communicative Skills in a Second Language, such that Second Language 
Learning Can be Enhanced Through* Classroom Discourse Within the 
General School Curriculxim and in Special Language Classes, Specify 
Discourse and Interaction Rules and Behaviors in School that will 
Encourage Native Language Maintenance, 5,5 

III , How can teacher's work be improved on the basis of the understandings 
achieved in the above research? 

6«,'^^ Develop and Field Test Materials and Procedures to Improve Teaching 
and Thereby Learning on the Basis of Knowledge about Linguistic Processes 
in the Classroom, 5,6 
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GOAL STATEMENT 

To develop an understanding of the mental life of teachers / 
a research-based conception of the cognitive processes that 
characterize that mental life, their antecedents / and their 
consequences for teaching and student performance. Such 
cognitive processes* include perception, expectancies, diagnostic 
judgment, prescription and decision-makin^^. Such an under- 
standing can be applied in further research on teacher 
selection, teacher education, and the development of 
technological or staffing innovations congruent with ways 
teachers think and feel. 
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The Clinical Act 
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in the Events of Teaching 
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Regarding 
Pupils . 
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SUMMARY 


The Panel on Teaching as Clinical Information Processing 
organized their research programs under seven approaches: 

1» The clinical act of teaching: diagnostic 

judgment and deci sion-mak jrna in the evpnts 
of teaching. 

2* Perceptions, attributions , and expectations. » 

3. Cognitive processes in selecting amonq instruction;^! 
and organizational alternati/ves 

a. Teacher perceptions of self,^4raie and teaching: 
reflection and feedback. f 

5. Organizational and structural determinants of 
cognitive functioning in teachers . 

6. Development of research methods. 

7. Theory development. 



DISCUSSION 

The approaches and programs of research described by this 
Panel rest on the assumption that we need to know far more 
than we now do about the mental life of teachers. Though 
iL is possible, and even popular, to talk about teacher 
behavior, it is obvious that what teachers do is directed 
in no small measure by what they think. Moreover, it will 
be necessary for any innovations in the context, practices 
and technology of teaching to be mediated through the minds 
and motives of teachers. To the extent that observed or 
intended teacher behavior is "thoughtless," it ntcrkfis no use 
of the human teacher's most unique attributes. Such , behavior 
becomes mechanical and might well be done by a machine. 
If, however, teaching continues to be done by human ^eachers 
(and in all likelihood iF will) , the question of 
relationships between thought and action becomes crucial. 

this emphasis on the cognitive functioning of teachers is 
consistent not only with the real^.ties of c\aSsroom life, 
but with important developments in contempors^y behavioral 
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and social science. One behavioral scientist, Herbert Simon, 
has observed : 

The capacity. of the human mind for formulating 
and solving complex problems is very small compared 
with the size of , the problems whose solution is 
required, for objectively rational behavior in the 
real world—or even for a reasonable approximation 
to such objective rationality. [After proposing the 
principle of "bounded rationality" to describe man's 
limited capacity for rational thinking, Simon 
continues] .. .the first consequence of the principle 
of boanded rationality is that the .intended rationality 
of an actor requires him to construct a simplified 
model of the real situation in orderrto deal with it* 
He behaves rationally with respect to"lhis model, 
and such behavior is not even approximately optimal 
witt> respect to the real world. To predict his 
beifavior, we must understand the way in which this 
simplified model is constructed, and its construction 
will certainly be related to his psychological 
properties as a perceiving, thinking, and learnina 
animal. . (Simon, H. A. The Sciences of the A rtifical 
Cambridge, Mass.: MIT Press, 1969.) 

Thus, an understanding of how teachers cognitively construct 
the reality of teaching and learning remains central to the achieve- 
ment of NIE's oveirall goal of developing the means to improve- 
the provision, maintenance, and utilization of high quality 
teaching personnel. A teacher may possess the full range 
of relevant instructional skills, but if he is unable to 
diagnose situations in which a particular set of those 
skills IS needed, the skills alone will be insufficient. 
Similarly, intelligent application of the methods of behavior 
analysis and modification is 'contingent upon accurate 
perceptions of student behavior, and upon warranted judgments 
and interpretations of its meaning. Recommendation of new 
personnel roles for teachers, or riew patterns of staffing 
and differentiation of responsibilities must be consistent 
with information-processing capacities, beliefs, and 
motives of teachers; or at least with the likelihood of 
promoting the necessary cognitive characteristics . through 
education and training. These are but a few examples of . 
how a better understanding of the teacher's mental life 
contributes to the a«fH3>vement of goals directly addressed 
by other panels at^his conference. 
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In this Panel report, there is a commitment to under- 
standing the ways in which teachers cope with the demands 
of classroom life, the circumstances in which these 
copings lead to successful teaching and learning, and the 
conditions under whicH they become- maladaptive. There is 
' a commitment to view the teacher as agents , rather than as 
a passive employer of. teaching skills or techniques, a 
marginal operator in a complex system of technology, or 
a set of personality^ traits and aptitude measure^, The^e 
is an orientation^ toward th^' t^eacher as cliniciaiy ^ not 
^ only in the sens^ of someone diagnosing specific forms pf 
learning dysfunct^ion or patl^Xo^ and prescribing parti-qular 
remedies, but mpr^T>5;;oadly aS' an individual responsible ' 
for a'ggregating and ruling' sense out of incredible ! 
diversity of information sources about individual students 
a^d the ciass coflectively ; b^c'inging to bea^. a growing^^ody 
' of empirit:al and theoretical work donstitutiji.g the research 
literature of eduction; Asomehow combining all that ^^forma- 
^tion with the teacKer's own expectations, attitiudes, beliefs, 
; purpostes; and having* to- respond , pjake- judgments , render 
^ decisions, reflect: and regroup to begin agaio. The 
actual ratio of reflecijion to reflex in teaching is itself 
an important subject for study, both iij terms of ^ how ^ 
teaching currently occuts ahd in terms of the potential 
limits, of change. Similarly, one must study the degree 
of flexibility one ought to expect from teachers in shifting 
from one mode of copying to another T or from a set of expecta- 
tions once developed regarding a group of youngsters/ to 
a modified and more' warranted set. 

With regard to method, the Panel respected the teacher's 
own self teports as an irhportant (though typically not 
suff icient) ' source of- data. Whether tfeated as^ the ubiquitous 
informant of anthropological inquiry, or the introspective 
probl%m-solver of inf drmation-processing research, or the 
interviewed (or questionnaired) holder of attitudes and 
beliefs of the social pyschologist , the panelists take 
seriously the value of the teacher's own description of how 
he or she constructs the reality of the classroom, of what * / 
''was done and why, of who the students -are and how he or 
^ she feels about' them, ' ^ ' 

There is a combinat'ion of concern for the human problems 
of teaching, and being* a teacher and a commitment to whatever 
forms of disciplined inquiry seem appropriate to the research 
problen^^and educatiortal setting, under investigation. The Panel 
represented as wide a set of meihodological orientat-ions 
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as one is likely to find in any single panel: anthropological^ 
observations in natural settings; mixtures of anthropological 
and social-psychological observations and codings of behavior 
in nat^ural settings; experimental psychological investigations; 
mathematical modelling &f behavior and information processing; 
clinical interviewing; and use of contrived non-natural 
settings via sin\ulation or micro-teaching. ^ 

The Panel also employed a variety of theoretical stances 
that translate into contrasting metaphors for looking at 
"the teacher as ..." — the teacher as diagnostician, as 
labeller, as self-fulfilling prophet, as decision-maker, 
as explainer, as attributor, and many more* 

Finally, Panel participants did not perceive their work as 
having relevance only to educational settings organized 
around the way schools are typically found today. Whether 
education proceeds according to IPI, CMI , PLAN, ot Mastery 
Learning; whether it goes^ on in pre-schools . f ree schools, 
or no schools; as long as* a human teacher pl^ys a central 
role in. making the process work, an understanding of how 
that teacher thinks and how that thinking can be helped to' 
function more effectively will remain a priority item for " 
.any agenda of research on teaching. 




T^e focal p^int of all research programs in this problem 
area remains cognitive functioning, or the mental life of 
the teacher. The five substantive research approaches 
(leaving out for the moment the method and theory ^ , 
development approaches) define contrasting families of 
{problems or top^ics for study. AH relate to the basic v 
questions: (a) , How do the ways teachers think — about 
* themselves, their work, cheir students, their subject 
matters and materials, the settin*^ in which they operate 
and the alternatives which they consider--af f ect the nature 
and quality of their teaching and students* learning? (b) What 
are the ways in which the equality of these cognitive processes 
can be enhanced, whether tKrough teacher|Se\ection, 
teachef preparation ^ (in-service or pre-slrvice) , restructuring 
of schooling, development of teaching aids (technological, 
human 'or both) or some combination of these? 

, The representation of the research approaches and their 
interrelationships is found in Figure 1. * 
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Approach 6.1 - The Olinical Act of Teaching; Diagnostic 
Judgment and Decision -Making in the Events of Teaching. 
Central to this prdblem area is the view of the teacher 
as a clinician, actiively processing information from 
many sources in order to render judgments and make 
decisions. These activities take place both in the "empty 
classroom" — the preactive phases of teaching, and in the 
real-time transactions between teacher and students — the 
interactive phases. In this clinidal model o^teaching, 
the teacher is seen performing a professional role quite 
parallel to those of physicians, lawyers, stockbrokers, 
military strategists (William James likened teaching^ to 
waging war), and other practitioners. The model focuses 
the researcher's attention on the manner in which teachers 
process information. They employ that information to 
^each diagnostic judgments 'and -to make prescriptive 
decisions as they attempt^ to respond appropriately to each 
student's learning difficulties and strengths. Because 
the activities surrounding teaching as diagnostic problem- 
solving and prescriptive decision-making form the core ^ 
of research in this area,] this Approach is considiE^red first 
and includes the largest number of currently defined 
research programs. 

Approach 6.2 - Perceptions, AttribirEl:Qns and Expectations . 
Whereas diagnostic teaching per se revolves around specific 
instructional encounters and situations^^ there are other 
kinds of judgments teachers typically make which are more\^ 
global, general or ' ascriptive. Such judgments' ("bright," 
"smart-aleck," "lucjcy," "street blood," "school blood /' 
"promising") may constitute an inference, about the causes 
of student behavior, may concern a characterization of the 
rgupil's general personality, or may be an implicit estimate 
of the likelihood of ^is future success. The judgments may 
be directed at speci:^ic students, or generalized across 
'groups of students. Programs of research directed at 
understanding these judgments — how they are formed and what 
consequences they hold for teaching and learning — ;form * 
•Approach 6.2.<» Clearly, a teacher's general assessment 
of a pupil's char^acteristlcs and the teacher's diagnostic/ 
prescriptive responses that pupil's specific learning 
performance will interact in potentially significant ways, 
^Thus,^*a particular research project might well cut across 
objeatives in two research approaches.'. ^ 
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Approach 6.3 - Cognitive Processes in Selecting .Among 
Instructional and Organizational Alternatives. In 
addition to making global judgments about pupils , teachers 
also ifiake general assessments about the organization of 
* classrooms (and themselves) for learning. Teachers have 

perceptions and make judgments regarding grouping of students, 
arrangement of physical settings, instructional materials 
and methods, topics and objectives, which are of a different 
6rder from their perceptions of pupils, but which affect 
their diagnostic decisions regarding individual^ pupils and 
groups iQi pupils. These perceptions and judgments relate 
to the teaching of some thing, some where , sometime, or 
somehow — rather than teaching some body . Research on the 
antecedents and consequences of these types of teacher 
thinking constitutes Approach 6.3. 

Approach 6.4 - Teacher Perceptions of Self, Role and Teaching ; 
Reflection and Feedback. The next approach focuses upon 
tJiie teacher himself, both as a holder of general beliefs, 
attitudes, motive^s and commitments toward a variety of 
individuals, otJjects and institutions;, and the teacher as 
an object of his own cognitions — aware of himself, his 
behavior and motives, and capable o'^ modifying his thoughts 
and actions on the basis of feedback and reflection. 
Approach 6.4 deals with this highly important area, in which 
may lie some of the keys to continuous teacher self -renewal 
and revised perceptions of pupils_and instructional tactics. 

Approach 6.5 - Organizational ^d Structural Determinants 
of Cognitive Functioning in Teachers. The mental life of 
teachers, whether occupied with thoughts of teaching acts (6.1), 
, learner characteristics (6^2), organizing and planning for 
^5^^,^<^^^eaching (.6.3), or reflecting on oneself and one's'own 
functioning (6.4), does not occur in a vacuum. Indeed, 
teachers' thinking takes place in a matrix of organizational 
a^id structural circumstances. This matrix includes variations, 
such as open classroom vs. traditional setting, individualized 
teaching system vs. grouped system, graded vs* ungraded, 
self^-coritained vs. individualized, 15 pupils. vs. 40 pupils, 
team teaching vs. injdividually managed classrboms, differentiated 
staffing traditional staffing, etc. These variations 
doutbtless affect the cognitive-sfunctioning of teachers. 
The programs of research in' Appro^ch 6.5 address the 
effects of such variables on the mental life of the teacher. 
Such organizational or technologicalV changes will not only 
influence how teachers think and whar they think about, but 
they must also be consistent with tM realities of how 
teachers think and feel. Thus, for example, many millions 
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of dollars wbrtHT of biomedical computing systems — hardware^ 
and software — are Lying underused, if usdd at all, in 
hospitals and major medical centers across the country, 
because no one bothered to investigate the ways physicians 
and other health personnel really thought about and did 
their work. The systems introduced may have reflected the 
latest 'state-of-the-art' View of how computers ought to 
perform. Unfortunately , those who introduced these systems 
ignored the cognitive and attitudinal realities of the 
prospective users. We should avoid a similar fate in attempt 
to reform teaching. - 

The last two approaches do not char.acte^'ize specific 
substantive thrusts within the problem area. Rather, 
they cut across topical concerns, and deax with problems 
of method and theory common to all approaches or necessary 
for relating approaches coherently with one another. 

Approach 6.6 - Development of Research Methods . Much of the 
research described in the previous approaches differs in 
' . emphasis and theoretical orientation from both the neo- 
"behaviorist experimental tradition and the psychometric 
tradition that have formed the mainstreams of American 
educational research. Therefore, neither the experimental 
design models of Campbell and Stanley (and their many 5> 
inventive variants) , nor the classical methods of measure- L 
ment are sufficient in themselves for research in these 
areas. Approach 6.6 describes a program of research aimed 
at refining and improving methods of systematic introspection 
or thinking aloud; decision analysis; anthropological 
studies of teaching, ^analysis and coding of complex 
descriptive protocols; and the like. 

Approach 6.7 - Theory Development. It was apparent during 
t^he Panel discussions that progress was made most easily 
when clear theoretical formulations were either available 
or could be readily produced. In the absenc^^ of theory, 
constructs refused to stay put, distinctions blurred and 
discussions were repeated e^|filessly. These are problems 
which will ndt be solved by more programs of empirical 
research alone. There is need to piirsue serious efforts 
in theory development in this field, through support of 
individual theoreticians attempting to formulate pieces 
of the domain, groups of investigators attempting theoretical 
rapprochements across formulations, or short-term 
conferences to bring togethejc representatives of theoretical 
positions that would otherwise be unlikely to communicate. 
In some ways, the Panel's (discussions were representative 
of this third approach. Such an effort is of particular 
importance in this problem area, since so many types of 





theory are already brought to bear on cognitive functioning 
of teachers, yet each is but a partial theory when compared 
to the full -span of cognitive functioning in which teachers 
engage. The recominendations of Panel 10 on Theory Develop- 
ment contain several suggestions which would be quite 
fruitfully pursued within the problem area of teaching as 
clinical information processing. 

For purposes of this Panel's deliberations, a research 
program was defined as a stream of inquiry—a linked 
set of questions which follows a general conceptual itiodel 
with respect to any given topic of investig^ETon, That is, 
-whatever approach to research on clinical ir/formation 
processing in teachers is being pursued, and\ whatever emphasis 
withm that approach has been identified, th4re are certain ' 
general questions which the NIE ought to con^der relevant, 
and which together constitute a' research proWr^m, These 
five general orienting questions are: ~ / 

1, What are the varieties of circum^Wnces urtder which 
the topic under investigation occur s^, is implicated, 

or might conceivably - be invol^ved? What are its ' — 
characteristics? In planning research oh teachers' 
causal ascriptions for pupil behaviors, the question 
would' be phrased.^ "What are the circumstances under 
which! causal ascriptions are made by teachers, and 
what forms do they take?" This question is abbreviated 
in the program description tables as What , 

2, What are the antecedents or determinants of the 
events or process in question? Why do they occut? 
In the specific example used above, this line of 

,.qtiestioning would ask: "Why aire such causal ascriptions 
made? What are the situational and internal antecedents " 
of causal ascriptions in teachers?" This question 
is abbreviated Why > 

3, How can these processes be Modified? This question 
essentially asks: Given an understanding of the antecedents 
of processes or events, how can these antecedents be 
manipulated or influenced in order to bring about 

changed In our specific example, it would be "How 
can we influence the causes of causal ascription or 
'the attributional process itself?" This question is * ' 
abbreviated How, 
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4, What consequences for- teaching and learning flow 
from these processes or events? For example, "What 

-effects on teaching or learning are discernible as a 
function of differences in patterns of teacher ascriptions 
of cause?" This question is So What . 

5. What are the implications of the findings of 
studies of modif iability for the practical improvement 

of practice-,-programs of teacher selection or preparation, 
changes in the organization or methods of schoolings, 
and the like? These questions of feasibility of 
translating the results of research into realities of 
practice are referred to as Now What > 

The five orienting questions can be asked with respect to 

each of the five substantive research approaches presented 

earlier • They are less clearly relevant €b the method 

and theory development approaches. Each of the specific 

program descriptions presented in the^complete document takes 

its research topic .and acquires its programmatic quality 

as a stream of inquiry through the five orienting questions. 

Thus, any given program of research becomes a 

set of possible linkages, and does not necessarily describe 

the required scope of any individual research project.. In 

fact, it is unlikely that any specific project will carry 

through an entire stream of inquiry. But, it is because 

NIE recognizes the linkages .that it can stimulate the 

pursuit bf linked inquiries, even though conducted by independent 

investigators. ^ 



LIST OF APPROACHES AND ILLUSTRATIVE PROGRAMS 



1. The Clinical Act of Teaching ^ . 6.1 

a. Analyze the Diagnostic Process 6.1.1 

b. Examine the Pervasiveness of 

Bias in the Diagnostic Inference 6.1.2 

c. Examine Teachers ' Diaqnoses in the 
Preactive Phase of Teaching 6.1.3 

^ d. Examine Teachers' Diagnoses in the 

Interactive Phase of Teaching 6.1.4 

e. Examine Diagnostic Teaching in the 
Subject Area of Reading (other 
-3ubject"^3:eas would reguire parallel 

lines of research). 6.1.5 

f . ^ Examine ways of Using Information ^ 

about Students in Arriving at 

Instructional Judgments ^ 6.1.6 

2> Perceptions / Attributions and Expectations g 2 

a. Examine Teachers' Perceptions of 

Students 6.2.1 

b-. Assess the Consequences of Labelling 
on both Teacher Performance and 
Student Response 6.2.2 

c. Examine Causal Ascriptions and the 
Educational process ^ 6.2.3 

d. Examine Teacher Expectations of Class 
Performance Level and Their Ante^cedents 

and Consequences 4 •6.2.4 

3. Cognitive Processes in Selecting Among 

Instructional Alternatives 6.3 

a. Examine Classrobirt Grouping Practices 
as Irjfluenced by Teacher Cognitive 
Processes ( 6.3.1 

b. Examine Individualization of Instruction - 
Especially in Terms of Cpnflict between 
Diagnosis and Discrimination . 6*^.2 
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Teacher Perceptions of S ^lf . Role, and Teaching 

a. Develop the Means to Improve the Self - 
Awareness of Teachers 

b. Examine the Cognitive Determinants of 
Teacher Motivation * 

Organizational and Structural Determinants 

a. Examine the Effects of School and 
Classroom Organization on the Development- 
and Stability of Teacher Expectations: 
Team Teaching " . 

b. Examine Pupil Record-Keeping S^tems as 
Determinants' of Teachers' Thinking about 
Pupils, Brograms and Instructional 
AltQa;Tia;^ves ' ^ 

Research Method Development 

a. Carry Out General. Studies of Methods ^ 

T^'eory nevelopTtipnt 
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The Panel, on Instructional Personnel Utilization organized its 
research programs under five Approaches: 

1. Generate scientific .knowledge on how the organizational 
and administrative aspects of the classroom and school 
support instructional personnel in reaching, educational 

* goals. 

2. Generate scientific knowledge on how the organizational 
and administrative aspects of the district and community 
support instructional personnel in reaching educational 
goals. ^ 

3. Generate scientific knowledge on how the physical aspects 
^ of the classroom and school support instructional personnel 

in reaching educational goals. 

4. Generate scientific knowledge on how the personal and social 
aspects of the classroom and school support ins truest ipjval 
"personnel in^ reaching educational goals* 

5. Generate scientific knowledg;e on how tke personal and 
social aspects of the district and community ^support 
instructional personnel in reaching instructional goals. 

DISCUSSION 

Early in' the conference, members of Panel 7 expressed 
doubt that ^.t is possible to carry out straightline planning toward 
particular goals and objectives in a field such as educational 
research which lacks an extensive, organized knowledge base. 
Questions have beep rais,ed about this kind of a planning process 
J.n cancer research; yet such a procedure is a hundredfold more 
questionable in a'^ield like education and in particular, in an 
area like tieache.r utilization where there is not yet a scientific 
and successful paradigm for research. Indeed, within the teacher 
utilization area, there is very little research and c^ertaini^ not 
enough to form a systems model* 

There was significant agreement among Panel 7 members that 
much of the earlier work qn teacher utilization had a manipulative 
quality, as if teachers were uninformed, poor ly mo t iva ted employees 
with whom a firm hand was advisable. Panel 7 deliberately 
structured its' programs to reflect a change in underlying values 
with respect to forming goals for research relevant to teachers, 
a change which recognizes the responsible, professional status 
and performance of teachers and other school personnel. 
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there was consensus that dependent variables otlj^r -^han 
simply "pupil outcomes" should be considered in theyarea of 
teacher utilization. Such issues as the naturer^^the teacher^s 
interaction with pupils and other' teachers an^ the nature of the 



teacher's planning behavior should 
variables • 

The original problem area 
conference outline focused the 



s ta t emen 
initial 




red as dependent 



ined in the/^^e-- 
the . panel 



t^a 



( 

Develop the means to improve *^he way 6v. in which t^^cher 
and other educational personnel are uti'Fizeid in the 
organizational, administrative, and physical environment 
of the classroom, school, and community • 

The panel discussed a number of the points embodied in this 
statement and agreed upon the following modifications: 

.The phrase "develop the means" was changed to "generate 
scientific knowledge .". this modification was made to 
reflect the research-based nature of the panel's task. 

0 



, It/ was 



agreed thXt the scope of the problem area included 

classroom teachers, other people in the classroom, principals 
an<^ specialists, hAxt did not include secretarial and 
clerical personnel, maintenance staff, lunchroom staff, 
or bus drivers unless such persons were judged to interact 
with ^student s in an instruct ional(^anner , 

•The personal and social aspects of the problem area were 
added-to the goal statement. 

.The impact of the school 4ifatrict setting was identified as 
being a part af the physfcal environment . 

A matrix was developed (see figure 1) to contai'^and display 
the five Approaches developed by the Panel, using the two dimensions 
of "Locus" (Within School and Outside School)^ and ScKcol Variables 
(Organizational/Administrative, Physical and Personal/Social), 
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Locus ' 

Variables ^ .^^J^^ 


Insijde 
School 


Outside . , 
School 


Organizational /Administrative 


7.1 


7.2 


Physical 






Personal/Social 




7,5 



Figure 1 
Matrix of Approaches 
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Approach 7.1 - Gen^erate scientific knowledge on hov the organizational 
and administrative aapects^of thB classroom and school 
support lustructlonal personnel in reaching education al 
. ' goals . 

Today's teacher is being asked to do a far more difficult task ^han 
ever befqre. Society no longer tolerates failure and early school- 
leaving as an acceptable outcome ,for a lafge proportion of students. 
The techniques of teaching have been greatly complicated by the 
introduction of a variety of materials ^nd media. No longer is it 
satisfactory to parents and professionals for teachers to use a - 
combination of lecture and recitation based on a single text per ' 
subject area. Content and processes must somehow be "individual^ized" 
so as to maximize learning.. The progress of individuals and the 
planning for their activities must l^e monitored and coordinated; the 
teacher has become a classroom d irec tori as ide frotfi his other roles. 

Recent research reveals a high level of innovation in the areas, of 
school organization and educational technology. But such innovations 
are frequently dropped, leading to a'^general cynicism abou-t the 
possibility of a pay-off in terms of student achievement. Some of 
the^se innovations are felt to show great promise, but the school 
s,taff is unable to solve the problems, they entail and thus get them* 
coordinatc-d into the claastoom and the school* In order for these 
innovations, in the technology of teaching to res in desired student 
outcomes, the adminis t r a t ion ' and organization of the school must under- 
go certain changes. In addition, staffing and organization patterns 
must provide greater support for the classroom teacher. Such 
personnel innovations as team teaching, differentiated staffing, and 
additional specialized personnel have been designed in part to 
provide additional support to the classroom teacher. However, each 
of these . changes in turn implies a series of role changes and the 
necessity forgpew and dif ferenty- skills on the part of classroom 
tcnchcrs, SuJStessful implemen ta^ ibn of innovations requj.res not 
only the organizational support for tiew teacher roles, bi4t: 
administrative support in terms of resources, encouragelc^g,*^ , 
planning time, and the like. 

This Approach hypj|||lies izes that the persistent organizationai failure 
to support the clj^sroom teacher is a prime cause of (a) thj( rapid 
disappearance of once-promising instructional innova t ionsK^nd (b) the 
failure of these innovations to result in improved studalht achievement. 

The objective of this Approach and* it's programs is to change 
organizational and admihis tra t ive arrangements in such a way as to 
reduce the isolation of the classroom teacher, and to provide more 
supervisory and expert time and resources while- at the same time 
delegating certain aspects of the teacher's role to aides-pr volunteers 
By redirecting personnel towarc^-the central objective of instruction, 
it should be possible to take full advantage, of improved technology 
in producing desired student outcomes. 
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Underlying this approach are aeveral assumptions concerning 
effective work organizations* One is that the structure of an 
organization must change as the technology changes so as to assist 
In carrying out the new tasks, A second assumption is that changes 
In technology and organization must be accompanied by the clear 
understanding of the expectations of the new roles, and by th^ 
acquisl^tion of new skills relevant to the interaction required 
of new roles. A third assumption is that school personnel must 
acquire the capab ility>->rb learn through experimentation over time 
how to solve the problem^ generated by innovation in both structure 
and technology. 

Approflch 7>2 - Generate scientific knowledge on how the organizational 
and administrative aspects of the district and 
community support instructional personnel in i;eaching 
educational goals . 

m 

This Approach is concerned with ways in which formal organizational 
and administrative aspects of environments ^district and community) 
external to the local school affect ways in yhich classroom personnel 
are utilized in their jobs and supported for the improvement of 
instruction. 

A summary of the background and current knowledge about this Approach 
must be divided into'two fairly different (but often overlapping) / 
traditions. One. has to do with thode formal managerial arrangements 
of the school district that rel^te^ to th6 effective utilization ot 
teachers. The second concerns community, dynamics and how these 
affect the ways in which classroom personnel are supported or not 
supported in attempts to improve classroom instruction. / 

It should be possible to generate many hypotheses linking commi^dity 
processes to the utilization and improve'ment of teaching. F,or 
instance, hypotheses should be gerierated on how to^use non- 
professionals from th^^dcalt XoWinunTry to e1i^:n^^~7rarTigtrt~^ teache r 



utilization patterns, on how to confront and handle in , a rational 
fashion organized protests agaijist the school, and on how to^relate the 
"community school organization" to increased support or nonsUpport' 
of teachers. This subapproach has great protnise; yet pres^rtt 
knowledge in this area is very limited. Y / 

Therefore, the specific purpose of, this Approach will be td generate 
scientific knowledge and practical procedures for increasing mutual 
influence between district personnel and teachers (on the one hand), 
and between citi*zens in the local community and teachers {on the 
other hand) to improve the utilization and performance of/ 
instructional personnel within schools. ^ 

Some assumptions that grow out of this orientation and that underlie 
the research ±n this approach areta, 
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it ds people^ who represent the primary resources* etiter Ing , 
being processed and utilized by, and leaving the schools 

« 

2, It is the quality of the group interaction' processes 
^ intervening between the incoming "people-f esources" and 

the outgoing ''people products" that will determine the 
school's instructional p^r f oril(iance\ 

3, Because schools are open systems, interpersonal 
/ - interactions at the "organizational interface" 

influence ways in which the "people-;resources" are 
utilized .and supported, 

4, A key perspective for studying such interaction^ as 
the '/organizational interface" (e.g,, "district personnel- 
school personnel" and "community participants-school 
pe^rsonnel") is to.view i:hem as inter perspnal transactions 
involving social inflyence j>rocesses, 

<^ . ./ » . 

5, different bases of social! inf lyenp^ characterize their 
interactions and will affect educational output differently, 

6, Social influence in such interpersonal transactions is 
not usually inevitably a "zero-sum game"; i,e,, increased sup- 
ervisory influence need not lead to decreased teacher 
influence, and increased citUzen influence need not lead 
to decreased teacher, influence*. As shown 15 years * 
of research at the Institute for Social Research at the 

' University of Michigan, all parties in the organizat ional- 
influ/^nce interaction can gain at the same time in terms 
of shared and valued outcomes. 

Approach 7 , 3 - Generate scientific knowledge on how the physical 
aspectg of the classroom and school support 
instructional personnel in reaching educational goals , 

Until recently, the facilities provided for formal learning 
activities were .standardized and had remained relatively unchanged 
over a long period of- time. So loiig as teaching was perceived as 
"telling," the only basic support requirement was rooms for 
lecturing. Suitable to this view, work stations for youndger 
learpers were simply desks that provided a place at which to listen 
and to read and write, and which, for logistical purposes, could be 
permanently arranged in fixed rows. Room sizes were determined 
by the number of students a single teacher could conveniently 
instruct. Buildings for learning were Collections of like-sized 
and interchangeable rooms. The only common variations on this 
arrangement have been provisions of a separate room for the 
collection of books (the library), a place for indoor exercise 
(the gym), and a place for large-group occcasions (the auditorium). 
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Research^in the area tends to underscore the signi'f icance of ' * 
environmental factors to staff functioning. However, there does 
not appear to be a great dea-1 ,of activity by educational researchers 
dealing directly with the problem. Findings in the broader field 
of environmental psychology need to be translated for" their 
specific meanings to educa^t ion . Llkewi&e , the field of sociology 
needs to be explored for its obvious contributions to the problem. 

Therefore, the objective of this Approa/^h is to generate a 
coordinated series of studies which wild document the cause and 
effect relationships between jphysical' environment in th,e school 
and classroom and the functioning of instructional staff. 

The concepts or theories affecting this Approach will be drawn 
from the disciplines of psychology and sociology. Within the 
problem areas developed at the NIE conference", the most likely 
overlap is with work proposed by Panel B in relation to changing 
educational roles. If the premises-of this Approach are valiti, 
physical environment wMl have a s t ron,g..Jt>af lu e*nc e on em<erging . 
role structure for teachers. 

It has been a^ssumed here that the way »taff is used is a function 
of the physical environment. It is further assumed that, if program 
goals are'^to be reached, the j)hysical environment must be one of 
the supportive factors which contribute to achievement of th'^e goals. 
This being the case, it becomes necessary, to establish not only 
the cause and effect relationships between staff functioning and 
the physical environment, but also the relative importance of the 
physical environment in the broad scheme of 'implement ing the 
instructional program. ^' 



Approach 7 . 4 - Generate scienl^ific knowledge on how the personal / 
and socia l aspec ts of the classroom and, sfchooj. , 
support instru^ctional personnel in ifeaching educational 



goals 

Teaching is a very personal /act in which t^le feelings, .attitudes 
beliefs, and values oj^ the p/erson doing the instructing have. a 
most significant impact on liow he/she functions as a teacher. i 
Teaching is carried out by jthe instructor within a soc/ial. cortex t / 
which affects how the teach.fer does his/her work. More s pec i f i cal/ly , 
the nature of the personalWsocial suppo^rt which ^ teacher receives 
influences' the foJLlowing, each of which can be hypo thesj^re^kto bef/ir 
a relationship to the accomplishing of in s t ru c t :^ona 1 j^ale by\ / 
8 tudents : . (a) the ways the/ teacher relates to-staden^s, (b) te\c)iiers 
willirngness and ability to/ create an4 innovate,' (c) j^eachers' \ 
willingness to profit frord staff development experiences and to j\ . 
\ implement instructional a^d program plans, (d) teach/fer job 



vsa tiaf at: tion , and (e) the: energy teachers can devotej' to instruction, 
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Overall, past research in the* area of this Ap-proach has been spotty 
and not directly focused on identifying the nature of how the total , 
personal-social support structure within which the teacher wor'ks 
assists or hinders him/her in reaching Instructional goals. 
Considerable conventional wisdom exists in this area, but it'has 
not been verified by carefully , developed research. * Persorial-social 
support for the teacher would seem to be an essential condition 
for the success*»ef other approachS^s aimed at assisting the teacher 
to become more effective in reaching instructional objectives. 

The specific purposes of this Approach then b^ecome (a) to d-etermine 
whether in fact such a relationship between personal-social support v 
and' teacK^r effectiveness does exist andr; if so, (b) to identify 
ways to produce such per sonal-^cial sunport. 

The emphasis in this Approach is basically on informal , primarily 
unofficial, at least partially unplanned types of per sonal-'social 
support.** One result of research in t^is area however might be to 
make the per s^onal-soc ial suppor.t strucsture of a school more formal, 
official, and planned. ♦ \ 




Study in this area is closely related to the study Qf the 
personal-social support climate for teachers in the district^tid 
community and to certain aspects of the organizational patten of 
the school as well as its physical structure. 

Research in this area must be focused on identifying how fhe 
indiv.idual teacher, as well as a group of teachers, responds to 
the personftl-T^ocial suppor t • sys t e|h of the school, -Differences 
among- t^eachers are likely to be g;re^, this being at least partially 
the result of diffetences in their self-reinforcing systems. 
If this reseatch is to be us ef ul/ to ^the school administrator, it 
must enable him/her to understand the personal-social support 
structure as experienced by teachers both as individuals and as a 
total staff. 

The basic assumption underlying this Approach is that there is 
an important relationship betWjSen the personal-social support ^ 
teachers receive and their effectiveness in reaching i^ris true tional* 
objectives, particularly when the teacher believes' himself/herself 
to be an important part of a significant »under taking . 

Approach 7 . 5 - Generate sciei^tific knowledge on how the personal 
' and social aspects of the district^ and commiTnity 
support instr^\ictional personnel in reaching 
ins tVuctionaj^^oals , " 



There are potent social /and; personal influences in the life' of a 
teacher which impinge unon /that person ' s Qffertiv^eness as a member 
of a group of people whope^'job it is to '^eep school " One way of 



ERIC 



8 / 



categorizing these personal-social influences is to refer to those 
informal messages and social encounters (interactions) which occur 
within the context of the work-station to which a teacher Is assigned 
in a particular school building and to thos-e that occur within the 
school building itself," The Panel on. Instructional Personnel 
Utilization has referred to these' as the internal influences — those 
directly related to the d'ay-to-^day work context of the teacher. 
Included in this category are the informal interactions between child- 
.ren and teachers, teachers and principals, and teachers and teachers. 

In addition to the'se internal influences are those -that ocQur out- 
side the specific context of the sphool, classroom, or area in which 
a teacher performs his/her duties. The Panel has referred to these 
as "External** influences. The external social-personal influences 
incl ude those associated wit h (a) other teacher s who perform their 
duties in other school buijhli^^s , (b) central office personnel 
who do not routinely come in personals-social contact iith teachers, 
(c) parents and other community persons, (d ) friends, 1(e) family, 
aad (f)- acquaintances • More formal 'influence mary be exerted on 
the social-personal level through teachers' associations, unions, 
^or other pro f ©iss ional groups. 

The Approach suggested herein is to develop a knowledge base 
concerning the latter set of "external, informal, social-personal" 
influences which in some measure limit,, or free, the teacher wijch 
respect to how the teacher will utilize his/her skills or to how 
the teacher is willing to be assigned (deployed, made a member of 
B tfeam, selected as a team leader, asked to work with "special" 
children, given developmental tasks su^h as writing new curricula, 
enlisted as a volunteer participant in special projects, and so 
on). The Panel recognizes that the aocial-per sonal influences to 
which we are referring may not lhave the most obviQuS and direct 
«corjnection with our basic focus on teacher assignment, and function* 
However, w^ cannot help but believe that pervasive messages ar e 
.conveyed to teachers within this "society which do influence their 
feelingb about thems elves ,/ abou t their schooling, and about the 
limits of theii; discret iorijnry poweris as professionals; and that these 
feelings in turn affect the\r performance. These messages are 
conveyed in a myriad of informal wayat — often unintentianal , ^ut 
nevertheless real. The messages affect motivation which in turn 
determines^ entraace into the teaching f ield , risk-taking and 
exploratory behavior once in^the field, and exit from the field 
(of direct contact with cfhildren, and/c^r— *44Acation in general). 




The basic assumptions underlying this Approacifc^ are 



1, Expectancies (values) are* communicated through social- 
personal systems external to a school. 
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Teachers are sensitl've- to these communications and derive 
estimates of their- own status from them. 

There is a positive correlation between status and motiv- 
ation to improve. 

The schools reflect the social power hierarchy of the 
coraraunity, . - 
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LIST OF APPROACHES AND PROGRAMS 

♦ - - 

Organizational and AdmlnlstVatlve Aspects of 
the Classroom and School Su/pport Instructional 
Personnel In Reaching Educjitlonal Goals > ? .1 

a. Organization of Staff 4lesources for 

Continual School Problem-Solving 7.1.1 

1) An Experiment In Using Teacher Teams In 

Solving Problems at the School Level 7.1.1.1 

b. Studies of Group Pr&cess Skills as 

Related to Staff CaiJa^lllty ^7.1.2 

c. Studies o^n Authorlt^ and EvaJjwt^dn^' 
In Relation to Staf/f^ Abil-lty to Carry 

Out Instructional Tasks 7,lr3 

d. • ' Rera'tfonshlp Betwefen Various Types 

of Accountability and the Group and 

Individual Behavior of Teachers 7.1 4 

Studies of the Socialization of Teachers 
Into Various Administrative and Organize-- ^ 
tlonal Arrangements ' 7^1 5. 

Effects of Organizational and Administrative 
Arrangements on Teacher Initiative 7.1.6 
g. Studies ot the Career Patterns of Instructional 

Personnel / 7.1 7 



^* Generat e Scientific Knowledge on Hov the y . 

Organiza tional and Administrative Aspects of ^ 
the District a nd Community Support Instructional 
Personne l In Reaching Educational Goals . 7 . 2 

a. Consultative Activities Within the District 

for Continual School Problem-Solving 7.2.1 

1) A Study of the Advantages' and ' Disadvan- 
tages of Two Sorts of Dlstrlctwlde 
Structures for Delivering Group Process 
Consultation to Teaching Teams 7.2.1.1 

b. External Influences on School Dlst;-lct 
Instructional Goals, Policies alid Processes 
that Affect School District Staff Assignment 

and Functioning 7 2 2 
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c. studies oi th.e Effects of Community 

Participation in Relation to Staff Support V 
for Instructional Programs 7.2.3 

i) A Study of the Effects of Several Types 
of Parent Participation on Instructional 
Personnel 7.2.3.1 

Generate Scientific Kaovledfge on Hov the Physical 
Aspects of the Classroom and School Support In- 
structional Personnel in Reaching Educational 
Goals . " 

a. Studies of the Relationship\of Physical 
Environment to Innovat Ive S ta'f f ing 

and Instructional Strategies for ^ 

Teaching \ - 7.3.1 

b. Relationshi(p of the Use of Learning 
Resource Materials and Equipmeht to 

Staff Assignments and Functions 7.3.2 

c. Relationship Between Aesthetic Quality 
of School Physical Environment and 

Staff Functioning and Morale 7 3 3 

d. Relationship Between Standards which 
Districts Use in Selecting Equipment 

and Supplies to Quality of Instruction 7.3.4 

Generate Scientific Knowledge on How the Personal 
and Social Aspects of the Classroom and School 
Support Instructional Personnel in Reaching 
Educational Goals . 7 ^ 

a. Studies of Informal Rewards and Costs - 

(Puniqhing Conditions) •in Relation to 

Staff Fjinctioning and Morale 7.4.1 

b. Studies- on Ways in which Informal 
Processes and Personal Characteristics 
Relate to Staff Assignments and Function- 
ing 7.4.2 

Generate ' Scientific Knowledge on How the 

Personal and Social Aspects of the District 

and Community Support Instructional Personnel. 

in Reaching Instructional Goals. ^ 7^5 

a. The Effects of the Social Settings and 
Population Composition of a School 
Community on the Assignment and Functions 
of Teachers 7.5.1 

. i) The Effect of Desegregation on Racial 

Composition of Teaching Staffs 7.5.1.1 
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ii) The Effect of Male Administrators on Teachers 

and the Socialization of Girls 7.5.1.2 

Hi) The Relationship Between the Low Status of the 

Teafaher Aides and the Representation « 7.5.1.3 

^ iv), The Development of a Methods for Treating Staff 

Interaction Problems When the Staff is Interracial 7.5.1.4 

v) The Relationship Between Career Ladder Opportunities 
for Teacher Aides and Their Effectiveness in the 
School Setting * 7.5.1.5 

b. Studies of^he Effects of the Status of Teachers as 
Communicated Through Informal Communications put side a^ 
Particular School on the Assignment and Function of 

Teachers * . , 7.5.2 , 

i) The Analysis of Community Definitions of TeacheB ' \ 
Responsibilities 7.5.2.1 

♦ 

ii) %he Relationships of Different Community Settings 
to the Interpretation of Status Among Teaching 

Staffs 7*5.2.2 

iii) The Relatipnship of Communications from Local Media 
to the Interpretation of Status Among Teaching 

Staffs -7.5.2.4 

iv) The Development of Alternattve Ways of Communicating 7.5.2.5 
Positive Statu s Indi cators to Teaching Staff , 7.5*2.5 

v) ~ The Develop^nent of Alternative Ways of Helping 

Teachers Identify Positive Messages Concerning 

TKeir Staffs 7.5.2.6 

vi) The Development of Alternative Messages to the 
Comnmnity to Influence Community Definitions of 

Teacher Responsibilities 7.5.2.7 

c. Varying^' Patterns of Informal Citizenry Influence on 
Schools and the Effect of their Values on Teacher 
Assignments and Functions 7.5.3 

d. Community Mobility and its Effect oA Teacher Assignments 

and Functions 7.5.4 
,e. The Effect of Student Progress Through the Educational 

System and Its Effect en Teacher Assignment and Function 7.5.5 
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. ' SCMMARY 

The Panel on Personnel Roles in New Instructional Systems organized 
it6 programs and projects under the following approaches: 

1. Investigate the characteristics and effects of totally new 
instructional sys terns » . , . 




personnel functions and roles necessary for 
evaluation and research on new instructional 
Systems, ~ I 

9 

3. Investigate the personnel functions and roles necessary for 
the selection > adoption. Implementation and continuation ' of^ 
n^ instructional systems, 

4. Investigate the Instructional functions which are integrally 
involved in operating, new instructional systems. 

^ 51 Investigate the ways in whi^ persons can bis prepared for 
^ new roles and funftiqgs. 
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V DISCUSSION 

An implicit assumption in the Panel's deliberations is that change 
will come to the school system and that it will represent a systematic 
development; namely, a systems approach • 

The systems approach begins, not with the teacher- in-a-classroom as a 
given, but wich an analysis of the goals which the system should 
achieve as its "output". The output is the educated person. Working 
from the output to the requirements necessary to achieve such an output 
has generated fair consensus on certain attributes a well-designed , 
system will have. .These attributes include individi^iza^ion of 
treatment responsive to student needs and goals, intensive capitalization 
in terms of high quality materials and validated procedures, and adequate 
staffing to perform. the required functions. It is generally agreed 
that the present "system" does not exemplify good design along these 
lines. 

The introduction of Change may involve the creation of totally new 
systems, an approach in vhich an attractive alternative to the existing 
system is offered as a model, inspiring other systems to follow its, 
lead. Oty it may involve significant revision of an ongoing "conventional" 
syistem, with a pe^od of adjuptment as old changes to new. 

' ^^proach. 8.1 involves investigating the characteristics and effects of 
personriel roles in the totally new educational systems. .In order 
to ipsure new systems instead of adaptations of existing traditional 
ones, it is intended that they be established with deliberate disregard 
for political, social and other constraints. Such an approach is 
intended to yield new ideas as to how to develop educational innovation 
at the total-system level. T^o programs are subsumed under this 
Approach: the first is a systematic planning of all aspects of an 
integrated, comprehensive instructional system which would not be bent 
to conform with policies, procedures and pressures inherited from 
existing school arrangements. Planning activities would include the 
establishment of goals, themes ,' policies , organization, personnel 
functio.ns, costs and scheduling of such systems. If the bold new 
design appeared feasible, the second program would implement it. A 
major Aspect of the implementation program would be an evaluation of 
its performance in the achievement of stated educational goals. 

Whether system design results in a model built outside the present 
educational system or in drastic changes within present schools, the 
development of new instructional systems requires new personnel frained 
in instructional technology as an applied science. The development of 
such personnel capabilities for research, development, and evaluation 
technologies constitutes Approach 8.2 . Among programs considered lender 
this Approach were several concerned with fostering an interaction 
between personnel vieveloping such new systems and personnel in exipfr^, 
systems. The intent is to improve the channels for input into the 
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research and development process from pr-^sen.t instructional personnel, 
and to increase the possible disseminability of the resulting research 
products^ In addition to such a needs-focusing role, the potential 
role of experienced teachers in the further development process was 
seen as a further area for experiment and study. 

t 

Approach 8,3 is concerned with the structures and strategies by which 
innovative systems could eventually stabilize into full realization of 
their potential value for improvement. In order to break the common 
historical cycle of initial enthusiasm, hard work on the innovation, 
^ and eventual return to normal, the Panel felt the n^ed for a more 

solid base of knowledge on (a) decision-makingf structures which encourage 
or inhibit innovation and change, (b) dissemination strategies, including 
demonstrations and the distribution of information about potential 
innovations, (c) ways of buil<Ji'ng in acceptability of the new system 
in terms of the alternative roles designed into it for existing personnel, 
and (d) installation strategies which take account of the full range of 
operative factors in the natural settsing. Such knowledge can be built up 
both through the study of existing systems, suph as the analysis of 
existing federal and state regulations in terms of their influence in , 
facilitating or retarding change, and through the development of new' 
models for systems change, Programs-^ganerated by the Panel in this area 
include a program to analyze Tand, model new decision-making structures for 
adoption and implementation of innovative systems, and a program aimed 
toward the development of a comprehensive incentive and support system 
which could effectuate the ^continued active interest and personnel 
^ participation iti innovative instructional systems. 

While Approadh 8,3 deals with the roles involved in the adoption and 
maintenance of new instructional systems ^ Approach 8,4 is concerned 
with delineation of roles necessary to the on-going operation of a 
smoothly installed new system. Looking into the future, systems 
involving mass media, computer-assisted instruction, and integrated 
multi-media systems as well as mostly print-based individualized ^ystesns 
are foreseen. The use of broadcast media introduces roles relatively 
new to education whose function and effect should be studied prior to 
large scale investment in the production of training materials. New 
personnel roles involved in open learning situations should be studied 
in the context of the success of the system and its ability to survive. 
Computer assisted instruction introduces new personnel requirements and 
support functi<|>ns which are significantly different from those in 
existing systeips. There is a marked need for, empirical testing of 
several different conceptions of CAI manpower with standard t3rpes of 
hardware, curriculum and pedagogy. Knowledge concerning the present 
status 'of differentiated staffing with regard to impact on 3tudents 
will help develop a mode;l for building future st;affing patterns that 
revard skilled teachers^' help in individualization of instruction and 
provide for shared decision making. Combinations of the above' roies, 
as well as others, in a single instructional system are also possible 
and worthy of 'investigation. 
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Approach 8.5 suggests a series of programs' aimed at locating or 
developing training procedures for roles in emerging instructional 
systems. Where such skills already exist, dLncentive systems to 
encourage their use, as in Approach 8.3, would be sufficient. Where 
such 3kills do not exist, pre-service and in-service training is 
required. Among the latter skills are those required in the local 
adoption of relatively well-developed systems (of which a few exist), 
and in management of new systems at the school-wide level (the 
principal's role) or the student interfice level (the role of the 
teacher and supporting personnel). Other personnel for whom training 
needs are identified include paraprofessional staff and even students 
themselves as they move to more active* participation in the planning 
and management of their own education. 
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LIST OF APPROACHES AND PROGRAMS 



1. Investig^f^ the Characteristics and Effects of Personnel 
Roles and^Functions in Model Nev Instructional Systems 
Which ArbySet Up in Isolation From the Usual Constraints 
Im_posed'<m Innovations Within Existing Systems and 
Schoolinj^C or Are Used, to Replace Existing Systems, 



8.1 



T — 

a. Develop plans for totally new instructional systems^ 

b. Implfttoent one or more totally new instructional 

8ys|:fem8 . 

2. Investigate the Personnel Functions and Roles Necessary 
for the ^esearch^ Development > and Evaluation of New 
Instructional Systems , 

a. Develop and eyaluate the feasibility of establishing 
a foi^aal institutional component serving school 
distt:|ct8, with the* purpose of obtaining teacher 

inputs into the identification of R€«D problems. 

i) ©evelop a rational model of' operation for 
obtaining teacher contributions to identifi- 
cation ^of R6^> problems, and describe key staff 
positions entailing such responsibilities* 

ii) Investigate arrangements for obtaining teacher 
contributions to identification of R&D problems 
in a large school, district, matched with a 
comparable project for establishing cooperative' 
Arrangements in small . districts. . --^ 

\ iii) Develop a formal needs assessment instriiment 
1 to enable teachers to systematically feed into 

the system their felt needs. 

b. Develop and evaluate various models for utilizing the 
participation of experienced teachers with instructional 
development teams in formulating and developing new ^ 
instructional materials. \ 



8.U1 
8.1.2 

8.2 



8.2.1 



8.2.1.1 



8.2.1.2 



8.2.1.3 



8.2.2 



r J 
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Inv^tlgate the Personnel Functions and Roles Necessary 
for Ihe Selection, Adoption^ Implementai(^ion> and / 
ConttAiation of New Instructional Systdttis > 



rze and propose new dec-lslon-miaklng structure 
iterrelationships among pers^^nel necessary 



a • Ana j 

e adoption, implementation, /and modification 
of innovation systems in a schoo^iVor school 
ys£em\n response to local need6/. 




SetVip a model decision-making structure for 
implmaenting a new instructional system, 
analyse personnel roles performed within 
that swuctur^> and prepare! materials for 
training appropriate pei?so|ns to perform 
those roles. 



b. Investigate the use of incentives and other support 
systems designed to increase the acceptance and 
continuation of new instructional systems. 



Investigate Operating Instructional 



Functions and Rdle^ 



Which Are Integral to New Instructional Systems . 



a,, 



b. 



e. 



f. 



Investigate the roles an<^' funct 
neojfessary for in&truction inydj^itig^ 
(broadcast) media. 



ions that are 
mass 



Investigate the roles and functions necessar^y 
for instruction in open learning ^ systems . 

Investigate roles and function^ necessary for 
incorporating computer-assisted instruction. 

Investigate the roles and functions that are 
necessary for educational settings which use 
combined instructional components. 

Investigate the roles and functions that are 
necessary for instruction using individualized 
material^ ba^d systems (e.g., IPI, IGE/ etc.)* 

i)' Develop and evalua*te a classroom-managed 
system of peer tutoring in grades 4-7, 
with specification of the functions of 

^ teacher and students and an evaluation 
of effectiveness* 

Develop atid evaluate novel component techniques 
involved in the roles of instructional management, 
presentation, (local) design, and evaluation. 

Survey differentiated staffing projects and 
develop models of differentiate^ staffing. 
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Investigate the Ways in Which Persons Can and Should 
Be Prepared for Nev Roles and Functions ♦ 

y 

a. DevelQp methods of training for loca^l adaptation 
of new instructional systems. 

b. Develop and evaluate alten^ative models of teacher 
training for roles and functions emerging from 
new instructional systems. 

i) * Develop a self-ins^tructional curriculum for 

off-campus use for college credit to, acquaint 
principals with tjie philosophy, techniques, 
aniJ implementation problems of continuous 
progress Systems. 

ii) Analyze common attributes of new instructional 
systems and develop training materials for the 
training of educational personnel. 

iii) Survey Teachers' Centers. 

c. Develop methods for training »paraprofessionals and 
parents on the instructional functions and roles 
that are integral to new instructional systems. 

d. Develop means by which students at any age level 
can be taught to perform main-line diagnostic, 

' managerial, tutorial, instructional and 
evalative functions for themselves and' others 
in an adaptive instructional setting. 
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through the identification and translation of useful existing 
knowledge from other disciplines. 

/ 



PARTICIPANTS 



Dr. AndreV Porter, c/hairperson 
Dr. T. AnAe Cleary / * / 

Dr. ChesWer Harris 
Dr. Richdrd Light j '-^ ! 

r. Donald L. Msyei: 
Dr. Barak Rosenshpuhe 
Dr. Mar&hall Smitfi / 
Dr. Su|an B. Stodblsky 
Ms. Lipda Glenderving, Seca^feta 




SUMMARY 



The Research Methodology Panel identified four general approache 
for 'achieving its stated goal: 

1. Develop and test new analysis.and design strategies 
appropjfiate for research on teaching. 

i j 

2. Increc^se understanding of existing measurement 
strategies for research on teaching and^ where 

, approj^riate, develop new measurement strategies. 

3. Identjii^, demonstrate and disseminate methodologies 
; from /other research disciplines which appear to 

have/ merit for research on teaching. 

Consider the utility of standards for improving ^ 
metipodological practice in research on teaching. 

DISCUSSION 

Although fnuch useful research on teaching has been conducted, 
Xhej utility of some of the research has been limited because 
o$ methodological problems, in some cases, appropriate; 
methodology was not available; in other cases, establistied best 
pr^cticek were not followed. In addition, there have b^en 
c^ses where methodologies were borrowed from other rese^arch ^ 
disciplines without a careful rethinking of this assumptions " 
involved. / 

iThus> Uhe intent of the Panel was to identify as many / 
me thodc^ logical problems as possible which limit the productivity 
of res4ardh on teaching. Because of the breadth of t|ie area 
Qonsidyfired, the time constraints, and the limited number of 
peopl4 inA^olved, it is likely that important problem^ .were 
pmitt^d, ^ Even those problems identified were ^escribed with 
varying ^ebre6s of specificity, it is hoped, therefore. 



. that thi/s document will stimulate productive written criticism 

/ ate 4-A ^ - - ■ ' - 

Lptions of these problems , and important prcSblems that 



^ t6 ^Se/ 
t/he deabri 
were/ br/iyted. 



relevance of problems identified, the adequacy of ^ 



The four Approaches that were adopted were believed to 
encompass all the methodological problems of research on 
teaching and are, therefore, neceasarily broad in natur^. 
The first two Approaches emphasize the nee& for new 
methodological developments which specifically address the 
needs of research on teaching. These two' Approaches 
consider problems of design and analysis (9.1) and measurement 
(9.2) respectively and, taken together, cover the full range 
of new methodological developments. The third i^proach (9.3) 
recognizes that there are existing methodologies developed 
in other research disciplines that may have relevance to re- 
search on teaching, but which are as yet untried in that 
context. The final Approach (9.4) is in response to the 
criticism that some of the research on teaching suffers from 
a failure to use the best existing methodological practices. 
It was suggested to the Panel that a statement on standards 
of methodological practice for research on teaching would be' 
useful in alleviating that problem. 

Approach 9.1 - Develop and Test New Analysis and Design 
Strategies Appropriate for Research .on 
Teaching 

The development of principles for the design and analysis of 
studies, has a long history, much of it stimulated by problems 
of research in specific fields. For example, during the early 
and mid-twentieth century, problexas of analysis of agricultural 
data played an inportant role in the develc^raent of techniques 
commonly used today. Even tzoday, we see many new developments 
coming from areas other than education. For example, response 
surface methodology has come primarily from industrial and 
engineering problems. Generally, there has been less input to 
this literature from education and teaching than from agriculture, 
the biological sciences, etc. 

Perhaps the major iippression left by reviews of current research 
on teaching is that problems of design and analysis are encountered 
at many stages, and are solved, if at all, in an imitative or 
derivative fashion drawing on analogies with earlier studies, 
especially 'those in agriculture. The Panel felt that it is time 
to put forth more systematic efforts toward developing principles 
for the design and analysis of studies within the special and ' 
possibly unique context of problems of education in general and 
the study of teaching in particular. 

With respect to design and analysis, then, several major programs 
need implementation. One is the understanding and explicatioji of 
methods of data reduction which yield (possibly) independent, 
minimal or reduced sets of descriptors of teaching processes and 
which adequately tag or reference the original observations. 



3 



A second is a better understanding of existing irodels and the 
creation of new models for identifying differential outcomes 
of teaching, possibly adjusted in one or more ways. This 
implies a concommitant need to search for and control some, of 
the many. variables that necessarily accompany the complex 
activity of teaching. Better ways are needed for (a) identifying 
confounding variables; (b) understanding how their influences 
operate; and (c) determining how those influences can be controlled, , 

A third is the problem of introducing explicitly into both design 
and analysis the use of prior and/or collateral information about 
the context and participants of a study which can, if successfully 
used, yield more efficiently designed studies, 

A fourth is how to make research on teaching a cumulative enter-, 
prise. As Light and Smith (1971) have observed, "significant 
knowledge in the social sciences accrxies ever too slowly, A 
major reason is that various research studies, on a particular <? 
question tend to be of dissimilar designs, making their results 
difficult to compare. An even more important factor is that 
social science studies frequently produce conflicting results, 
which hinder theoretical developments and confuse those responsi- 
ble for the implementation of social policies," At a minimum, 
what is needed are: (a) "criteria for determining when data 
from dissimilar studies can be pooled," and (b) "methods for 
recognizing fundamental differences in research designs, and 
avoiding the creation of artificial dif ferences,""^ (Light, r7j. 
and Smith, P.V. Accinnulatina evidence: Procedures for resolvina 
contradictions among different research studies. Harvard » 
Educational Review , 1971, 41, 429-471. 



Approach 9,2 - Increase Understcinding of Existing Measurement 
Strategies for Research on Teaching and 
Where Appropriate Develop New Measurement 
Strategies 

There is a long and productive history of psychometrics which 
has supplied theory and guided test construction for research 
on teaching. Much of this history, hdwevef, relates to 
concerns for measuring individual student aptitudes and achieve- 
ment. Although this work has been and will continue to be 
of value to research on teaching, other aspects of measurement 
appear to need greater attention. For example, "better measures 
of so-called non-cognitive outcomes of teaching, including 
personality characteristics, self-perce»tion , values and 
attitudes, are required. There is a neld for better theories 
about such constructs, but development of measures is also 
constrained by the need for bettef methodd'ogy, A second 
example is the need for bettet measures of the teaching process, 
particularly in natural settings.*' A third example is the need 
for group assessment measures as contrasted with measures 
Q designed to assess individual differences. 
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Current and pending legislation has given a sense of 
urge;nL6y to the solution of. these problems. Thirty-one 
states are* now considering laws requiring all 
applicants for a teaching license to demonstrate their 
teachina effectiveness. One example is the Stull Act, 
1972, of California, which regtiires all school districts to 
evaluate their teachers. Many of theyse evaluations will 
be based on student outcomes, yet existing measures of 
student ouf*comes are largely restricted to cognitive 
achievement\ and aptitudes. Even these measures may not be 
appropria^ Nsince most were designed to distinguish' among 
individuals j( students) and not groups (classrooms) . 

Most pf the programs Identified under Approach 2 can be categorized 
as dealing with concerns for ineastiring the process of teaching or 
the outcomes of teaching. There are several motivations for 
measuring th6 process of teaching. For example, knowledge about 
what actually takes place in a learning situation is useful in 
stimulating new theories about teaching strategies. A second 
example is that much research is devoted to providing teachers 
with new strategies believed to facilitate student learning. If 
student outcomes do not reflect the attempts to change teaching 
strategies,' then there are at least two explanations. One is 
that the strategies were not effective, and the second is that 
the strategies were not implemented by the teachers. Better 
measures of the teaching process are necessary to narrow the 
alternative explanations. 

With respect to the measurement of outcomes, there is a need 
to develop or select measurements which are valid for assessing 
the effectiveness of an intervention. This need stems from 
the in appropriateness of many current and widely used measures, 
e.g., MAT, Iowa. These measures are inappropriate for assessing 
teacher (and curriculum) effects for a variety of reasons: 

1. They were not designed to measure the outcomes 
of interventions. 

2. They in practice deal with the measurement of 
relatively stable characteristics. 

3. Functionally, the major purpose of these tests 

is the sorting and selection of individual students. 

1^ 
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Recent efforts have been at least partially responsive to these 
measurement needs. First, numerous classroom observation 
instruments have been developed to measure the teaching'* process , 
and some useful data banks describing classroom activities 
are now available, e.g., the SRI Follow Through classroom 
observations. Nevertheless, the properties of existing 
observation schedules are generally not well understood, and 
problems of validity and realiability remain. - Second,. the 
recent surge in criterion-referenced measures should alleviate 
some of the concerns about existing achievement measures. 
Still, most of the work is cc^centrated on assessing individual ^ 
student performance, while one of^iihe major needs for 
research on teaching is to assess the impact of interventions. 

There is an intimate relationship between this Approach and the 
Approach to develop and test new design and analysis strategies. 
Clearly, the reliability and validity of measures can limit the 
utility of a research study. Design and analysis strategies must fce 
sensitive to the weaknesses of the measures, but cannoj: turn 
useless data into xiseful data. There is some reason to believe 
from recent literature that concerns for solutions to design 
and analysis problems have overshadowed concerns for solutions 
to problems of measurement. If so, this lack of balance should 
be. corrected. 

Approach 9 . 3 - Identify, Demonstrate and Disseminate Methodologies 
/ from Oth^r Research Disciplines Which Appear 

to Have Merit for Research on Teaching ^ 

The first two Approaches reflected a concern for the development 
of new design, analysis and measurement techniques which serve 
the unique needs of research on teaching. Most of the methodology 
currently used in research on teaching, however, was originally 
developed in other research disciplines. There are at least two 
reasons, why continued identification, translation and dissemina- 
tion of methodologies from other research disciplines seems 
warranted. First, in many cases, these borrowed methodologies 
have served the researchers of teaching quite well« Second, 
where existing useful methodologies are available, duplication of ^ 
development should be^ avoided. 

Because of the considerable interest in developing methodologies 
across a wide variety of research disciplines, staying abreast 
of methodological, developments Is no smallT task and would 
appear to require' a major effort in its own right. At a minimum, 
the Approach calls for an awareness of methodological develop- 
ments in econometrics, sociology, psychology, anthropology, as* 
well as applied and mathematical statistics. These methodolo- 
gical developments need to be screened for their potential 
utility for research orl teaching, and the more promissing 
methodologies tried out in a demonstration mode. As a start, 
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the Panel attempted to identify (in the form of programs) a few 
methodologies that at least on the surface appear to have' 
utility for researtxh on teaching. These include Organizational 
Development Methodologies (9.3.4), Computer Simulation (9.3.5), 
Path Analysis (9.3.6) ^ and Scaling Methods from Consumer 
Research (9.3.7). \ 

Approach 9.4 - Consider the Utility of Standards for Improving 
Methodological Pradtite in Research on Teaching 

^Setting methodological standards has been a. fairly common 
practice. The hope is that through the establishment of a set . 
of minimal levels of acceptable quality, the consumer will be 
protected. Perhaps the most relevant example is the APA-AERA 
standards for test piiblishers. In addition, several other 
groups are also considering the possibility of standards for 
^ program evaluations. Two reasoiis were suggested for attempting 
' to develop such standards for research on teaching. The first 
was that some research on teaphigg contains methodological 
flaws, many of which are common across time and across studies. 
The second reason was that much of the research done on 
teaching is not cumulative in nature. It is difficult, and 
sometimes impossible, for teachers and/or educational researchers 
;^ to pool together results from studies dealing with common 
interest areas. 



Nevertheless / the consensus of th^ Panel was that it is 
neither desirable nor possible to legislate (through standards) 
the methodological quality of research on teaching. Researchers 
must take a creative approach to data analysis and be willing 
to use multiple strategies in order to obtain full utility 
. of their data. It seems likely that methodological standards 
for research on teaching would piilitate against such practices 
and, instead, promote rather routine and unthinking analyses. 
Further, research on teaching has special yet varying 
methodologiG)^ needs which one set of standards could not begin 
€o address. It was decided, therefore, to discourage the^ 
development of methodological standards. In place of standards 
the^Panel recommended several programs to facilitate communication 
of Tfnrormation about how to handle methodological problems 
that are of major concern in research on teaching. 

This approach contains two main ideas: (a) establishment of 
archival data which can be used for secondary analysis and for 
illustration of the results of alternative design and analysis 
strategies; and (b) procedures for disseminating the results 
from the first three Approaches. The desired result is to 
encourage those doing research on teaching to use the "best 
known practices" in measurement, design, and data analysis. 
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LIST OP APPJIOACHES, PROGRAM^ AND PROJECTS 



1. 



Develop and Test New Analysis and I 
Design Strategies Appropriate for / 
Research on Teaching ' ^ 9.1 

a. Analysis Problems Related to / ' . 

Hierarchically-Nested Data 9.1.1 

i)'^ Models for Estimating Relations 
Among Variables at a Lo^r Level- 

of Aggregation 9.1.1>fi 

ii) Models for Data Aggregation " 9.1.1.2 

iii) Analysis of Unbalanced Designs 9.1.1.3 

iv) Consequences of Violating the . 

Assumption of Independence 9.1.1.4 

v) Analysis of Non-Independent 

Student Data ' 9.1.1.5 

J3. The Utility of .and Methods for Conducting 

"Tru^ Experiments" in ^Re^rch on Teaching 9.1.2 

i) Use of Incentives for Participation 

m. "True Experiments" 9.1.2.1 

.ii) Ethical Issues of Conducting "True 

Experiments" 9.1.2.2 

iii) "True Experiments "Within Quasi-Experiments 9.1.2.3 

c. Data Analysis Procedures for Quasi- 
or Correlational Studies 



i) At3 justing on Multiple Fallible + 
Covariables 

d. Development and Exploration of Formal 
Models for Incorporating Information 
About the -Ex-tent of Implementation of 
Teaching Strategies into th? Evaluation 
of Those Strategies in Terms of Outcomes 

t 

^ oo 



9.1.3 
9.1.3.1 



9.1.4 



e. Investigation of the Utility of 

Longitudinal (time - series) Designs 
for Various Types of Research on Teach- 
ing and Concomitant Analytic Problems 9, 1,5 

f • Empirical Selection of Models of the 

Teacher/Student Interaction Process , 9,1,6 

g. Procedures for Combining the Results 

of Related Studies over Time 9, 1,7 

h. , Procedures for Studies of Teacher 

Effectiveness ^ 9,1,8 

i) Problems Due to Lack of Random 

Assignment 9,1,8,1 

ii) Following Students Over Time 9,1,8,2 

iii) Prodedtires for Combining ^Several 

Intraclass Correlations into a Single * 

Estimate 9,1^,8,3 

i. A National Study of Current Educational 
Practice Analyzed at the Behavior 
Setting or Organization of Instruction 
Level 

i). Development of Behavior Setting 
Types 

ii) Economical Ways of Acquiring Infor- 
mation on Behavior Settings 

iii) National Survey of Classroom Behavior 
Settings 

Increase Understanding of Existing Measurement 
Strateg ies for Research on Teaching, ' and Where * 
A^PPro<>riate Develop New Measurement Strategies 9,2 

a. Educational Significance of an Effect/' 9,2,1 ^ 

i) Indirect Validation / 9,2 • 1,1 

ii) Direct Validation / ' 9,2 •1,2 
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b. Analysis of the Desirable Properties of 
Tests Stratefied by the Purposes of 

the Tests 9.2.2 

c. Construction of Tests with Face 

Validity . 9,2.3 

i) Development of New Measures which 'are 

Tied to the Purposes of Instruction '9.2.3.1 

ii) Development of Measures Dealing with 

Non-Cognitive Outcomes 9.2.3.2 

iii) Development of Measures for Observa- 

tions of Student Process Variables / 9.2.3.3. 

d. Analysis of Crossed Design Achieve- 

, ment Tests 9.2.4 

e. Test Bias 9.2.5 

f. Evjgluation of Profiles 9.2.6 

g. Defining Desired Teacher Performance 9.2.7 

h. Development of Measurement and 

- Observational Procedures to Describe 
Degrees and Types of Implementation 
of the Components of Various Teaching. 
Processes and/or Programs ' 9.2.8 

i) Measuring Implementation- 9.2.8.1 

ii) Stability of Student and Teacher 

Behaviors 9.2.8.2 

i. Studies to Improve the Reliability 

of Observational Procedures ' 9.2.9 

Identify, Demonstr ate and Disseminate Methodolog ies' 

from Othe r Research Disciplines wMch Appear t o 

Have Merit for Research on Teaching" 973 



a. Optimal Designs for R^learch on 

Teaching ^ 9.3,1 
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Problems in Developing Measiorement 
Procediafes to Describe Various Teaching 
Processes or Progtanis 9.3,2 

c. Evolutiojnary Operation . 9.3,3 

d. Organizajtional Development Methodology 
for Use |in Formative Research on 

Teaching Strategies 9i,3.4 

e» Computer Simulation 9.3.5 

f. Path AnapLysis and Other Models for 
Estimating Causal Relationships 9.3.6 

g. Scaling Methods from Consumer Research 9.3.7 

h. Generalizing from Non -Random Samples 9.3.8 

i. Investigation of Potential ^Uses of 
Exploratoiry Data Analysis Developed 

by John Tukey 9.3.9 

i) Stem-and-leaf plots 9, 3, 9,1 

^ ii) Robust/Resistant Regression . , 9.3.9.2 

iii) Jackknife Procedures 9.3.9.3 

« 

j. Analysis Model for the Estimation of 
Non-Additive Effects of Teaching in 
Other Than Factorial Designs 9.3.10 

k.Developmeiit of Statistical Decision Theory 
Models for Mpnitoring the Instructional 
Process 9.3,11 

i) Monitoring Individualized Instruction 

Programs 9.3.11.1 

ii) Decision Theoretic Approach to 

Problems of Test Bias 9,3,11.2 



/ 
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Ji* Consider the Utility of Standards for 
Improving .Methodological Practice 
* m Research on Teaching 9.4 

a. Secondary Analyses and Alternative 
Designs \ 9.4.1 

b. Research Data Archive ^ * - 9.4.2 

c. Training Programs 9.4.3 

d. Providing the Methodological Capacity 

to Support Research on Teaching 9.4.4 

e. Test Evaluation Manuals 9.4.5 
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SUMMARY / 

Ttxe Panel on Iheory Development concentrated on the ways and means 
of advancing theory development in general rather than on the sub- 
stantive problems of theory development in any particular area of 
research on teaching. Attention was, therefore, focused on four 
independent mechanisms that seemed to be most potent in attacking 
the difficulties, involved in theory development. The mechanisms 
became the Approaches under which the Programs were organized: 

1. "Back-room Groups" — working groups on comparative 
theory and methodology. 

2. "Loners" individual programmatic theoiry development. 

3. "Book of Examples" — instruction in theory development. 

4. "One-shot" projects on particular short-term needs. 
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DISCUSSION ./ ' 



The history of western science shows that theory development is the 
be^t and most efficient means of advancing knowledge and cojitrol of 
natural phenomena. In education, however, and particularly in the 
study of teaching, research and practice often appear devoid of 
theory. At least, it is fair to say that the theories guiding research 
and practice here have remained largely implicit, unfprmalized, ^ 
and unclear. Theoretical work has not yet become a major activity of 
educational researchers working on the study of teaching. This is 
perhaps understandable, given the relatively short time that systematic 
and programmatic research has been pursued and supported in the * 
United States, However, through the second quarter of this Centurjr, 
and. particularly during the pas't two .decades, diverse research efforts 
have produced scattered arrays of empirical findings^ As research 
findings accumulate, there is an increasing need to organize what 
has been learned into theoretical form. And there is increasing 
need for this system to* be guided by, and toward, theoretical 
issues. Theories are useful well beyond their role in structuring 
knowledge, or the pursuit of knowledge, for its own sake. They are 
not merely the esoteric playthings of academicians. They package 
accumulated knowledge for diss^ination and application in further 
research and, perhaps more importantly, in practice. In education, 
theory may provide the best, most efficient means of translating 
research into practice. Teachers and teacher trainers do not apply 
research evidence directly; they apply theories that make research 
evidence understandable and usable. And theory can also be aj, 
medium of communication from teaching practice to research. ' 

Thus, Improved theories will help define, organize, and guide 
continuing research. They will provide vehicles to carry research 
to practice and practice to research, for the examination and 
improvement of each. And they will serve, as well, the systematic 
planning and funding efforts of NIE, 

The goal to which this Panel.^ is addressed is to: 

Advance the development of theory that improves understanding, 
prediction, and control of phenomena in the teaching process 
and their antecedents and consequences. 

This is an awesome goal. While the Panel had no difficulty in adopting 
this statement of the ultimate goal, members did express doubt that a 
small panel in a four-day conference could make really significant 
headway on the broad front implied by the statement. Given these 
limits, it was agreed that the Panel should concentrate on the ways 
and means of advancing theory development in general, and in the abstract, 
rather than on the substantive problems of theory development in any 
particular area of research on teaching. Theoretical issues in any 
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particular area of research on teaching would best be left to the 
consideration of the relevant substantive panels. Hie Panel also 
chose not to elaborate the casa in favor of attention to theory, 
or y the definition of what does and does not constitute a theory, as 
thjpse issues hav^ been well discussed in tie literature. The Panel 

2ggested several sources which argue in favor of and against 
phasis on theory, and which discuss 'definitional issues. 
/ • ^ 

the act of making theory is a creative human behavior and is 
Influenced both by forces within the individual theorizer and in the 
social, cultural, economic, and political context within which the 
theorizer works. Hie act itself, and the processes that influence it, 
are themselves open to systematic philosophical and scientific analysis. 
Such analysis may be the best means of discovering and/or inventing 
the ways in which improved theory construction, and hence improved 
theories, can be obtained. 

Scientific crWtivit^Tiibe of ten i^een a topic of learned discussion. 
There have been armchair aesctiptions ot steps involved in building 
and testing theories ahd in human problem-solving in general. And 
there has been psychologLtal research on the correlates of creativity 
in theoretical work. Bu^ little is yefc known about predicting or 
fostering creative theory development among researchers. On the assump- 
tion that those who themselves are distinguished^ for their scientific 
creativity know best how to advance it, a meeting of some of the world's 
most prominent scientists and philosophers of science was held 
recently in West' Germany. (See Science, June 21, 1974, Vol. 184, 
p. 1273; full proceedings to appear in ^cerpta Medic'a .-) Selected 
quotations from the Science report on thi^s meeting, by T. H. Maugh II, 
will help detail the problem area faced by this Panel , and connect 
it to the general problem faced by all who are chargdd with the goal, 
of "advancing the development of theory/' 

" •'More than 90 percent of scientific innovation, it is frequently 
argued, has been accomplished by fewer than '10 percent of all 
scientists. This situation presumably exisfcs because only a few 
scientists have creativity— that ill-defined state of mind which 
allows yhe investigator to forge anomalous or apparently unrelated 
facts ihto bold new chains of theory. Uie pace of innovation 
could certainly be increased to meet pr^essing technological 
[and educational, and other social] problems if the number of 
creative scientists could be increased, but how to accomplish 
this feat remains a very difficult problem. Is it, in fact, - 

^ possible to teacfh creativity? Is it possible evert to create 
conditions that nurture preexisting creativity? o\ is it 
possible only to expand the number of practicing scientists in 
the hope that the percentage of creative scientists will remain 
constant? 



" . • . Itie conference . , . [was] less productive than its sponsors 
might have hoped* Bie assenibled gxovfp was able to agree on 
many innate characteristics that contribute to creativity-*- 
characteristics that would be readily recognize^ by anyone 
familiar with the vast literature about creativity— but it did 
not reach any consensus about what might be done to enhance 
these characteristics. 

"Perhaps the principal problem, as Leon Eisenberg pointed out • . • ^ 
is that the scientist who attempts to explain in retrospect how 
he developed a creative idea is only rationalizing a series of events 
that he thinks might have happened, . , . Innovation is, for a 
majority of people, essentially a preverbal process; . • , translating 
that thougjit process into words almost certainly alters the 
perception of the process. Many conclusions drawn from this verbal 
reconstruction of the creative process may be incorrect if the 
reconstruction is itself faulty. 

"... A major element in scientific success is the ability to 
distinguish between ideas and good ideas. Creativity, suggested 
Sir Karl Popper, can be divided into two stages—obtaining ideas 
^ and criticizing those ideas to determine which are worthless and 
which are worthwhile. . . . The ability fco generate ideas is the 
innate part of creativity that probably camxot be altered, while 
the development of a critical faculty is the essential part of 
creativity that can be nurtured through education. Failure to 
develop this faculty, argued Gustav Bom, is one of the major 
causes of scientific sterility. . . . 

••And how is this creative facility developed? Generally, most of 
the participants agreed, through the master-apprentice relationship 
that arises from working with a successful scientist. 

••But few young scientists are able to enjoy the Itixui^y of working 
and associating with Nobel-quality scientists. What then can be 
done to help them develop this necessary critical faculty? Most 
of the conference participants argued . . . that, 'creative science*,^ — 
could not be taught in universities. Many . . /spoke derisiveljix^ 
4. . • teaching courses in creative writing, suggesting that it is 
not possible to teach creativity in any subject. 

•• . . . I But] most such courses are actually teaching criticism of 
creative writing. That is, the instructor . . , [assumes] that the 
students have some creative writing ability, then teaches them how 
to distinguish good writing from bad writing, how to avoid making* 
certain types of mistakes in writing, ^nd how to avoid the banal 
and the trivial. The analogy tO...J^Xi&Atiy3 science, is straight 
forward and. though the application * f the concepts may be some- 
what more difficult than is the case with creative writing, thfe 
benefits that might be derived from tliis type of education in 
science could be far greater. •' 



We draw from these remarks ^nd from our own panel discussion at 
least four kinds of issues involved in the problem of advancing 
theory development. 

!• Despite centuries ^of theory development in science, the process . 
of theory construction and the means of promoting it are not well 
understood. There are relatively few creative theoreticians in 
established sciences, and fewer still in new areas of research such 
as education* 

2. The impression is strong that theory development is at base the 
product of hard, solitary, cognitive work by individuals--not by groups, 
programs, systems, or other organized collectivities--and that 
individuals differ in innate creative potential for theoretical work. 
There is considerable doubt that theoretical productivity can be 
improved by education or training. Yet there is no solid evidence 

that it cannot be advanced by organized learning of some sort. Parts 
of the process appear to have been learned in the past by imitation in 
maste^r-apprentice relationships. For example, it is felt that the 
development of a critical facility can be' learned. Some ideas and 
" analogies from other fields can serve as models for instructional 
attempts. And some other mechanisms for facilitating theoretical 
work seem promising enough to be well worthy of trial. 

3. Advancing theory in education is an especially complex problem 
because of the complexity of educational phenomena. All that is 
known about human behavior is potentially relevant to behavior in the 
educational ^realm. And educational phenomena seem to have unique or 
emergent properties requiring a kind of theory not derivable directly 
from behavioral and social science, 

4. Theories in education, and particularly theories of teaching, need 
ultimately to be both descriptive and prescriptive-normative in 
character. That is, theories In education need both to provide 
explanations of what happens in an educational , setting,, and to indicate 
improvements that should be pursued. While this distinction between 
functions of theory has long existed in established sciences and their 
applied fields, nowhere is the demand for close relationship between 
description and prescrtpiign greater than in education today. The 
cpordination of these two functions and the normative or value 
considerations that condition their form is not well understood. 

Early in the Panel's -deliberations it became clear that a hierarchical 
description of this' problem area was not the most productive way to 
proceed. Unlike the problem of specifying substantive research in a 
field, the problem of theory development' seemed best attacked by 
elaborating the various difficulties, problems, and unanswered questions 
that inhibit theoretical advance, and then identifying or inventing 
ways and means of overcoming, or at least reducing, these Impediments. 
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Using the hierarchical description of this problem area seemed to 
interfere with this process. Thus, the hierarchical structure was 
set aside in favor of a facet or matrix structure in which difficulties 
could be crossed with mechanisms for attacking them. Here, incidentally, 
is an example of another kind of difficulty inhibiting theory develop- 
ment; different structural models (or theories) can constrain or 
facilitate conceptual analysis of a particular problem. The contrast 
between hierarchical and facet structures shows them to possess 
different powers for. different theoretical purposes. 

To construct the matrix, eight difficulties that impede theory 
development were listed to fo^ eight separate columns. These were 
stated in the form of questions. Then, four possible mechanisms were ^ 
indentified that held some promise for reducing or eliminating at 
least one, and potentially several, of the difficulties. These 
formed the rows of the matrix. The eight difficulties wfere stated in 
the form of questions: 

1. What theories or theoretical constructs exist for application in 
research on teaching, and how can these be identified and selected? 
It is clear that a wide variety of theories and constructs exists in 
social and behavioral science. There are concepts available from 
philosophical analyses of scientific research, or normative considerations 
in education, and of the act of teaching as well. There might also 

be useful constructs derivable by analogy from physical and natural 
science. These constructs can be grouped into major forms or types of 
theory, or subdivided to iden^tify key variables ^d relationships. 
Until we have some conception of the catalog of possibilities, it will 
be difficult to judge which lines of theory development are likely to 
be most useful. • 

2. What constraints on new theory development are imposed by currently 
dominant pa^igms? The Zeitgeist , or "temper of the times," the 
societal, philosophical, or cultural traditions, and the current 
fashions in research and statistical methodology, all constrain 

theory development. There is need for continuing consideration of these 
metatheoretical and methodological issues, and for critical evaluation 
of current programs of research, both to explicate the constraints and 
to identify areas of potential theory developmenjt that have previously 
been ignored. 

3. How are theories constructed from research? from practice? from 
other sources? We know very little- about the psychology of thec/ry 
construction, or about the social, economic, and political forces that 
shape theory development. Without adequate understanding of these 
processes, we cannot hope to promote improved theory development 
effectively or efficiently. 



4. How are good theories constructed? We need better understanding 
of the role of critical eyaluatibtt in theory development. 

5. How are theories applied in research? in practice? 

6. Are unique theories of teaching necessary? To what extent can 
theories of teaching be derived from other theories? 

7. How can coramunality, trans latability, and systematization of 
theoretical and technical language be achieved? 

^ 8. How can we keep people (from) rediscovering "wheels** and "spooks"? 
On the one hand, considerable theoretical resources are wasted in 
> discovering and developing new ideas that are old, and in pursuing 
ideas that are illusory, i. e., that have been disproved or are 
unprovable. On the other hand, sound theory development requires 
that considerable effort be expended in replication and generalization. 
And old illusions sometimes become new facts as theory and methodology 
develop, and fashions change. Research on teaching needs to be made 
both cumulative and reflective. 

Attention was then focused on four mechanisms which seemed most 

potent in attacking the largest number of difficulties; These mechanisms 

were adopted as approaches. — - 

Approach 10.1 — Working Groups on Comparative Analysis, Evaluation, and 
Integration of Theory Developmg^tits . 

The basic objective of this Approach is to provide 
the field with an independent .^anel thats^^has wide 
knowledge of thi^ories, theo3*y' development, theory 
comparison, and methodology and can review and comment 
on and integrate the existing literature. This would ' 
be accomplished by forming one or more ^relatively 
permanent working groups of specialists £n social- 
behavioral science, education arid philosophy. 

Approach 10.2 Individual Programmatic Theory Development 

This Approach is premised pn the observation that 
primary theory development in a substantive field 
requires long, hard work by a researcher working 
* alone, without short-term constraints on schedule and 
productivity. Examples of great theory in the 
history of science show the crucial importance of 
solitary unconstrained intellectual work at significant 
points in the process. The Panel ^outlined four 
specific needs for program activities in this approach': 
^ research on a psychological theory of theory construction 
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(10.2.1); philosophical analysis of the extent to 
which unique theories of teaching, as opposed to 
theories borrowed from social-behavioral science, 
are required (10.2.2); theories of * social, cultural, 
economic and political processes that promote on 
constrain theory development (10.2.3); and research 
on how theories are extended beyond the data they were 
designed to explain (10.2.4). The Panel also 
advocated a fifth program that would be begun later 
that would fund individual theorists for intensive 
^ , theory development effort (10.2.5). 

Approach 10.3 — Instruction in Theory Development 

The basic purpose of this Approach is ,to provide a 
better understanding for the prospective theorizer^ 
either researcher or practi'tioner , of examples of 
theory development processes and the choices and 
difficulties faced therein, V/hile it may be premature 
to consider broad approaches aimed at instructing 
researchers and teachers in theory development, it could 
be extremely useful to have examples--case studies 
of theory development in process and perhaps also of 
theory in application* 

Approach 10.4 One-Shot Studies on Delifflited Needs 

There are several specific needs, both for promoting 
progress across other approach categories and for 
dealing with other isolated but critical issues. 
These seemed best addressed ty delimited one-shot 
projects. 

Specifiq^ purposes of these study projects are as 
follows : ' 

• Provide for identification of implicit and explicit 
theory used by teachers in practice including 
analysis of common sense constructs. (10.41) 

• \Develop, a matrix of existing behavioral and social 

science theories and constructs^^^er&ssed with 
teaching roles and problems, crossed with methodologies 
appropriate for study of theory-problem inter- 
sections, (10.42) 

• Provide for analyses of communality and trans- 
latability of theoretical and technical language, 
(10.43) 
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•» Provide for studies to determine the value 
' . implications of theoretical constructs, and the 

values of researchers that lead to these theories. 
(10.44) 

The 4 X 8 matrix formed by crossing difficulties in theory development 
and mechanism (approaches) is shown Ifl Exhibit I, wich the four adopted 
approaches as rows. Within each approach, one or more Programs are 
defined. The identifying number for^ each Program appears in only one 
row .(Approach) but in all columns (difficulties) on^ich it beaL. An 
asterisk denotes the cell to which each program is primarily addressed. 
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* n ^ 

LIST OF APPROACHES AND PROGRAMS 

!• Working Groups on Comparative Analysis ^ Evaluation^ and ^ 10.1 
Integration of Theory Developmenf * 

a. Compar,ative and Integrative Theory Evaluation 

and Development 10.1.1 

2. Individual Programmatic Theory Development 10.2 ' 

a. Psychological* Process of Theory Construction 

Related to Research on. Teaching 10.2.1 



b . Social, Cultural, Economic, and Political 
Processes Influencing Theory Production and 
Application in Research on Teaching 10.2.2 

c. Philosophical Analysis of Need for Unique 

Theories of Teaching 10.2.3 

Theory Extension and Utility Testilng 10.2.4 

e. General Project Description for Individual 
Research Awards in Particular Intersections 
of Theory and Practice 10.2.5 

3. Instrudtion in Theory Development 10.5 

a. Development of a Manual of Theories and 

Theorizing for Researchers 10*3.1 

Ip. Development of a Manual of Theories and 

Theorizing for Teachers 10.3.2 

4. One-Shot Studies on Delimited Needs ^ 10.4 

a. Identifying Implicit Theories of Teachers 10.4.1 

Development of a Matrix Representing Basic 
Constructs from Behavioral and Social Theories, 
the Methods by Which They are Operationalized , 
and Their Applicability to Teaching 

Functions. 10. '4. 2 

c. Collation and Analysis of Theories used in 

Studies of Teaching . 10.4.3 

d. Identifying the Values Implicit in the 

Practices of Researchers on Teachers 10.4.4 

e. Conceptual (Philosophical) Analysis of the ^ 
Language of a Given System for Studying 

Teaching ' 10.4.5 
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